2024-06-11T15:48:01.621 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-11T15:48:01.621 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448 --name teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/orig.config.yaml 2024-06-11T15:48:01.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T15:48:01.753 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7749448' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8517 sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz15g7zKPzc67uI7Jq7i4s1ZExe3vuN7S9UVxp5oo59RgnsXV9EXd07ITvOzm2brlzw1aihEhgym//LBFM8M6Y= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEVr/ms81UTKCojlxqvuJaufY2ztwqq07O9mCVfnkeVVEKfrpjkTgGF3J1qRSr566fZ6QpOEJ/ygBOIFbevruM= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEepngUFznJC9hZsdobjMDK6MQWzJu6ucYasmbKMHaW/h81GnXP//mE6a0UwnoyQNAwGeRA7D8CYbwPMlC0KRKQ= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn9P3oO9UBQDmfZub+qwKRoqgCRI9UEoRCUvv2aeosFGC9AXW9sVw3kPa7zvatxhlnfVYNE0PxEei4mIMdqwH8= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsx.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-10_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-11T15:48:01.753 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa; will attempt to use it 2024-06-11T15:48:01.754 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks 2024-06-11T15:48:01.754 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-11T15:48:01.755 INFO:teuthology.task.internal:Checking packages... 2024-06-11T15:48:01.776 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3f51ea3944d39ca13aa40153c9a4ee298306679d' 2024-06-11T15:48:01.776 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-11T15:48:01.776 INFO:teuthology.packaging:ref: None 2024-06-11T15:48:01.776 INFO:teuthology.packaging:tag: None 2024-06-11T15:48:01.777 INFO:teuthology.packaging:branch: squid 2024-06-11T15:48:01.777 INFO:teuthology.packaging:sha1: 3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:48:01.777 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-11T15:48:01.941 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2976.g3f51ea39 2024-06-11T15:48:01.942 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-11T15:48:01.949 INFO:teuthology.task.internal:no buildpackages task found 2024-06-11T15:48:01.949 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-11T15:48:01.996 INFO:teuthology.task.internal:Saving configuration 2024-06-11T15:48:02.009 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-11T15:48:02.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-11T15:48:02.053 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 15:42:34.671696', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz15g7zKPzc67uI7Jq7i4s1ZExe3vuN7S9UVxp5oo59RgnsXV9EXd07ITvOzm2brlzw1aihEhgym//LBFM8M6Y='} 2024-06-11T15:48:02.087 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 15:42:34.673165', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEVr/ms81UTKCojlxqvuJaufY2ztwqq07O9mCVfnkeVVEKfrpjkTgGF3J1qRSr566fZ6QpOEJ/ygBOIFbevruM='} 2024-06-11T15:48:02.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 15:42:34.669888', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEepngUFznJC9hZsdobjMDK6MQWzJu6ucYasmbKMHaW/h81GnXP//mE6a0UwnoyQNAwGeRA7D8CYbwPMlC0KRKQ='} 2024-06-11T15:48:02.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-11 15:42:34.674865', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn9P3oO9UBQDmfZub+qwKRoqgCRI9UEoRCUvv2aeosFGC9AXW9sVw3kPa7zvatxhlnfVYNE0PxEei4mIMdqwH8='} 2024-06-11T15:48:02.139 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-11T15:48:02.145 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-06-11T15:48:02.145 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['osd.0'] 2024-06-11T15:48:02.145 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['osd.1'] 2024-06-11T15:48:02.146 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['osd.2'] 2024-06-11T15:48:02.146 INFO:teuthology.run_tasks:Running task console_log... 2024-06-11T15:48:02.263 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd87e183ac0>, signals=[15]) 2024-06-11T15:48:02.263 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-11T15:48:02.269 INFO:teuthology.task.internal:Opening connections... 2024-06-11T15:48:02.269 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-06-11T15:48:02.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:48:02.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-06-11T15:48:02.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:48:02.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T15:48:02.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:48:02.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T15:48:02.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:48:02.583 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-11T15:48:02.590 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-06-11T15:48:02.608 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-06-11T15:48:02.608 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-06-11T15:48:02.664 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-06-11T15:48:02.664 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-06-11T15:48:02.664 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-06-11T15:48:02.665 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-11T15:48:02.666 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-11T15:48:02.666 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-11T15:48:02.666 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-06-11T15:48:02.689 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-06-11T15:48:02.708 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-06-11T15:48:02.708 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-11T15:48:02.765 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-11T15:48:02.766 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-11T15:48:02.766 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-06-11T15:48:02.790 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-06-11T15:48:02.807 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-06-11T15:48:02.807 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-06-11T15:48:02.864 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-06-11T15:48:02.865 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-11T15:48:02.866 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-11T15:48:02.866 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-11T15:48:02.866 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-06-11T15:48:02.881 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-06-11T15:48:02.899 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-06-11T15:48:02.900 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-06-11T15:48:02.957 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-11T15:48:02.958 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-11T15:48:02.958 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-06-11T15:48:02.981 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-11T15:48:02.989 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-11T15:48:03.038 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-11T15:48:03.038 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-06-11T15:48:03.041 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-06-11T15:48:03.043 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-06-11T15:48:03.045 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-06-11T15:48:03.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-11T15:48:03.070 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-11T15:48:03.070 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-06-11T15:48:03.099 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-06-11T15:48:03.101 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-06-11T15:48:03.105 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-06-11T15:48:03.191 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-11T15:48:03.262 INFO:teuthology.run_tasks:Running task kernel... 2024-06-11T15:48:03.277 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-11T15:48:03.277 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-11T15:48:03.277 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T15:48:03.278 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T15:48:03.278 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T15:48:03.279 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-11T15:48:03.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:48:03.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:48:03.296 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-06-11T15:48:03.297 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-06-11T15:48:03.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:48:03.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:48:03.298 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-06-11T15:48:03.299 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-06-11T15:48:03.353 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-437.el9.x86_64 2024-06-11T15:48:03.353 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-437.el9.x86_64 2024-06-11T15:48:03.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-06-11T15:48:03.354 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-437.el9.x86_64 2024-06-11T15:48:03.354 INFO:teuthology.task.kernel:Running kernel on smithi129: 5.14.0-437.el9.x86_64 2024-06-11T15:48:03.354 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-06-11T15:48:03.356 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-437.el9.x86_64 2024-06-11T15:48:03.357 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.14.0-437.el9.x86_64 2024-06-11T15:48:03.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2024-06-11T15:48:03.358 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-437.el9.x86_64 2024-06-11T15:48:03.358 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-437.el9.x86_64 2024-06-11T15:48:03.358 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-06-11T15:48:05.663 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-11T15:48:05.740 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-11T15:48:07.181 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.1 MB 00:02 2024-06-11T15:48:08.253 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.1 MB 00:03 2024-06-11T15:48:08.977 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 19 MB 00:02 2024-06-11T15:48:10.112 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-11T15:48:10.217 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 19 MB 00:01 2024-06-11T15:48:14.586 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:02 2024-06-11T15:48:14.753 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-06-11T15:48:15.265 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-06-11T15:48:16.704 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 17 kB 00:00 2024-06-11T15:48:16.881 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 17 kB 00:00 2024-06-11T15:48:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 17 kB 00:01 2024-06-11T15:48:17.640 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-06-11T15:48:17.809 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-06-11T15:48:17.977 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-06-11T15:48:22.863 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-06-11T15:48:22.965 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-06-11T15:48:23.158 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-06-11T15:48:23.175 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:01 ago on Tue 11 Jun 2024 03:48:22 PM UTC. 2024-06-11T15:48:23.463 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-06-11T15:48:24.927 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-11T15:48:24.927 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-11T15:48:24.971 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-11T15:48:24.971 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-11T15:48:25.024 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-11T15:48:25.034 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-06-11T15:48:25.035 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:48:25.036 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 80 M 2024-06-11T15:48:25.036 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 124 M 2024-06-11T15:48:25.036 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-06-11T15:48:25.066 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-06-11T15:48:25.072 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout:Install 4 Packages 2024-06-11T15:48:25.073 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:48:25.074 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 80 M 2024-06-11T15:48:25.074 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 124 M 2024-06-11T15:48:25.074 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-06-11T15:48:25.188 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.190 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.193 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.198 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-11T15:48:25.198 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-11T15:48:25.239 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.239 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.243 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.304 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-11T15:48:25.320 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-06-11T15:48:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:48:25.322 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 80 M 2024-06-11T15:48:25.322 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 124 M 2024-06-11T15:48:25.322 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-06-11T15:48:25.391 INFO:teuthology.orchestra.run.smithi129.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.1 MB/s | 893 kB 00:00 2024-06-11T15:48:25.546 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.547 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.551 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:25.564 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.2 MB/s | 893 kB 00:00 2024-06-11T15:48:26.139 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-06-11T15:48:26.643 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 759 kB/s | 893 kB 00:01 2024-06-11T15:48:26.672 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 26 MB/s | 29 MB 00:01 2024-06-11T15:48:26.990 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-06-11T15:48:26.993 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:48:26.993 INFO:teuthology.orchestra.run.smithi089.stdout:Total 41 MB/s | 80 MB 00:01 2024-06-11T15:48:27.343 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 8.5 MB/s | 16 MB 00:01 2024-06-11T15:48:27.692 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-06-11T15:48:27.851 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-06-11T15:48:28.030 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-06-11T15:48:28.030 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-06-11T15:48:28.665 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-06-11T15:48:28.963 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-06-11T15:48:28.963 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-06-11T15:48:29.010 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 12 MB/s | 29 MB 00:02 2024-06-11T15:48:29.014 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:48:29.014 INFO:teuthology.orchestra.run.smithi171.stdout:Total 22 MB/s | 80 MB 00:03 2024-06-11T15:48:29.066 INFO:teuthology.orchestra.run.smithi129.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-06-11T15:48:29.709 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-06-11T15:48:30.080 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-06-11T15:48:30.080 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-06-11T15:48:30.437 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 17 kB 00:00 2024-06-11T15:48:31.043 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-06-11T15:48:31.044 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-06-11T15:48:31.340 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-06-11T15:48:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-06-11T15:48:32.086 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:48:32.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:33.489 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-06-11T15:48:33.982 INFO:teuthology.orchestra.run.smithi129.stdout:(3/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-06-11T15:48:34.183 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:48:34.241 INFO:teuthology.orchestra.run.smithi129.stdout:(4/4): kernel-modules-core-5.14.0-452.el9.x86_6 3.3 MB/s | 29 MB 00:08 2024-06-11T15:48:34.243 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:48:34.244 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.7 MB/s | 80 MB 00:09 2024-06-11T15:48:34.277 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:34.811 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:34.942 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-06-11T15:48:34.961 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:35.289 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-06-11T15:48:35.289 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-06-11T15:48:36.213 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-06-11T15:48:36.213 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-06-11T15:48:36.563 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-06-11T15:48:36.955 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:37.106 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:38.568 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-11T15:48:38.569 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-11T15:48:38.640 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-06-11T15:48:38.665 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-06-11T15:48:38.683 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-06-11T15:48:38.683 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2024-06-11T15:48:38.683 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout:Install 4 Packages 2024-06-11T15:48:38.684 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:48:38.685 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 80 M 2024-06-11T15:48:38.685 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 124 M 2024-06-11T15:48:38.685 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-06-11T15:48:39.027 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] kernel-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:39.027 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] kernel-core-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:39.032 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] kernel-modules-5.14.0-452.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-452.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:48:39.267 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:48:39.280 INFO:teuthology.orchestra.run.smithi163.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.6 MB/s | 893 kB 00:00 2024-06-11T15:48:39.367 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:39.719 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:39.766 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:41.814 INFO:teuthology.orchestra.run.smithi163.stdout:(2/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-06-11T15:48:41.814 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:41.928 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:41.996 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:42.142 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:42.806 INFO:teuthology.orchestra.run.smithi163.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 8.2 MB/s | 29 MB 00:03 2024-06-11T15:48:44.247 INFO:teuthology.orchestra.run.smithi163.stdout:(4/4): kernel-core-5.14.0-452.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-06-11T15:48:44.250 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:48:44.250 INFO:teuthology.orchestra.run.smithi163.stdout:Total 14 MB/s | 80 MB 00:05 2024-06-11T15:48:44.526 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:44.945 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-06-11T15:48:45.303 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-06-11T15:48:45.303 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-06-11T15:48:46.261 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-06-11T15:48:46.262 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-06-11T15:48:46.655 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:46.897 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:46.947 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:48.655 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-06-11T15:48:49.396 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:48:49.497 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:48:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:48:52.324 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:48:57.188 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:14.073 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:14.113 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:14.468 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:14.468 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:49:14.469 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:49:14.469 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:49:15.250 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:49:15.251 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-06-11T15:49:15.623 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:15.695 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:15.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-11T15:49:15.696 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T15:49:15.696 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T15:49:15.697 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-11T15:49:15.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T15:49:15.697 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:15.748 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:15.748 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:15.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-06-11T15:49:15.788 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 68.el9 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8264254 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-11T15:49:15.789 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:49:15.790 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-06-11T15:49:15.791 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-11T15:49:15.791 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-452.el9.x86_64 2024-06-11T15:49:15.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-11T15:49:16.058 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:16.098 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:16.331 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-06-11T15:49:16.470 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:16.470 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:49:16.470 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:49:16.470 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.291 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.292 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:49:17.292 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-06-11T15:49:17.642 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:17.720 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:17.721 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-11T15:49:17.721 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T15:49:17.721 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T15:49:17.721 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-06-11T15:49:17.721 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T15:49:17.721 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:17.738 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-11T15:49:17.763 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-06-11T15:49:17.766 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-06-11T15:49:17.773 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:17.773 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:17.773 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-06-11T15:49:17.780 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.g8HJUuhM88 2024-06-11T15:49:17.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.g8HJUuhM88 2024-06-11T15:49:17.803 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-06-11T15:49:17.803 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-06-11T15:49:17.803 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-11T15:49:17.804 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:49:17.805 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-06-11T15:49:17.806 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-11T15:49:17.806 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-452.el9.x86_64 2024-06-11T15:49:17.806 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-11T15:49:17.861 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.g8HJUuhM88 2024-06-11T15:49:18.006 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.g8HJUuhM88 is 6KB 2024-06-11T15:49:18.026 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.g8HJUuhM88 2024-06-11T15:49:18.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-06-11T15:49:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-11T15:49:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-11T15:49:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-11T15:49:18.104 INFO:teuthology.orchestra.run.smithi089.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-11T15:49:18.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-11T15:49:18.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-06-11T15:49:18.497 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-06-11T15:49:19.858 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-11T15:49:19.894 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-06-11T15:49:19.897 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-06-11T15:49:19.913 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.4M5Zsu8CQf 2024-06-11T15:49:19.913 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4M5Zsu8CQf 2024-06-11T15:49:19.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.4M5Zsu8CQf 2024-06-11T15:49:20.112 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.4M5Zsu8CQf is 6KB 2024-06-11T15:49:20.161 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.4M5Zsu8CQf 2024-06-11T15:49:20.175 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-06-11T15:49:20.236 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-11T15:49:20.237 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-11T15:49:20.237 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-11T15:49:20.237 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-11T15:49:20.238 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-11T15:49:20.388 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-06-11T15:49:20.989 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:21.030 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:21.421 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:21.421 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:49:21.421 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:49:21.421 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:49:22.235 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:49:22.236 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-06-11T15:49:22.619 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:22.697 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.697 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:22.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-11T15:49:22.698 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T15:49:22.698 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T15:49:22.698 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-06-11T15:49:22.698 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T15:49:22.698 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:22.750 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:22.750 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:22.750 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.06 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 68.el9 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Group : Unspecified 2024-06-11T15:49:22.781 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 8264254 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : builder@centos.org 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-11T15:49:22.782 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-11T15:49:22.783 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-11T15:49:22.783 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-06-11T15:49:22.783 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:49:22.783 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-06-11T15:49:22.783 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-11T15:49:22.784 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 5.14.0-452.el9.x86_64 2024-06-11T15:49:22.784 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-11T15:49:23.370 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-06-11T15:49:24.829 INFO:teuthology.orchestra.run.smithi129.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-11T15:49:24.867 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-06-11T15:49:24.869 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-06-11T15:49:24.885 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.DROLskqFtN 2024-06-11T15:49:24.885 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DROLskqFtN 2024-06-11T15:49:24.954 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.DROLskqFtN 2024-06-11T15:49:25.093 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.DROLskqFtN is 6KB 2024-06-11T15:49:25.142 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.DROLskqFtN 2024-06-11T15:49:25.156 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-06-11T15:49:25.227 INFO:teuthology.orchestra.run.smithi129.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-11T15:49:25.227 INFO:teuthology.orchestra.run.smithi129.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-11T15:49:25.227 INFO:teuthology.orchestra.run.smithi129.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-11T15:49:25.227 INFO:teuthology.orchestra.run.smithi129.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-11T15:49:25.229 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-11T15:49:25.389 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-06-11T15:49:31.394 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:31.435 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:31.729 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:31.729 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-11T15:49:31.730 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-11T15:49:31.730 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-11T15:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-11T15:49:32.491 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:49:32.492 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-06-11T15:49:32.862 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:32.934 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.934 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:32.935 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-11T15:49:32.935 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-11T15:49:32.935 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-11T15:49:32.935 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-06-11T15:49:32.935 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-06-11T15:49:32.935 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-06-11T15:49:32.987 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-11T15:49:32.987 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-11T15:49:32.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.06 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 68.el9 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Group : Unspecified 2024-06-11T15:49:33.018 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 8264254 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : builder@centos.org 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:49:33.019 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-11T15:49:33.020 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-11T15:49:33.020 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-11T15:49:33.020 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2024-06-11T15:49:33.020 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:49:33.020 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2024-06-11T15:49:33.021 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-11T15:49:33.021 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 5.14.0-452.el9.x86_64 2024-06-11T15:49:33.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-11T15:49:33.629 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-06-11T15:49:35.002 INFO:teuthology.orchestra.run.smithi163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-11T15:49:35.034 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-06-11T15:49:35.036 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-06-11T15:49:35.051 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.zpSldkLwTv 2024-06-11T15:49:35.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zpSldkLwTv 2024-06-11T15:49:35.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.zpSldkLwTv 2024-06-11T15:49:35.258 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.zpSldkLwTv is 6KB 2024-06-11T15:49:35.307 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.zpSldkLwTv 2024-06-11T15:49:35.321 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2024-06-11T15:49:35.382 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-11T15:49:35.382 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-11T15:49:35.382 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-11T15:49:35.382 INFO:teuthology.orchestra.run.smithi163.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-11T15:49:35.383 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-11T15:49:35.529 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-06-11T15:49:48.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-11T15:49:48.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:49:48.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:49:50.393 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-06-11T15:49:50.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:49:50.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:49:55.397 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-06-11T15:49:55.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:49:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:05.540 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-06-11T15:50:05.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:50:05.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:06.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-06-11T15:50:08.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-06-11T15:50:13.791 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-06-11T15:50:15.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:50:15.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:17.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:50:17.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:18.686 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-06-11T15:50:20.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-06-11T15:50:22.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:50:22.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:25.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-06-11T15:50:30.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:50:30.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:32.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:50:32.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:37.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:50:37.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:40.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-06-11T15:50:49.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:50:49.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:50:51.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-06-11T15:50:52.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-06-11T15:51:02.522 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-06-11T15:51:03.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:51:03.043 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-11T15:51:03.044 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-06-11T15:51:03.090 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-452.el9.x86_64 2024-06-11T15:51:03.090 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-11T15:51:03.090 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T15:51:03.090 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-11T15:51:04.091 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-11T15:51:04.091 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T15:51:04.148 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-06-11T15:51:04.191 DEBUG:teuthology.parallel:result is None 2024-06-11T15:51:04.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:51:04.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:51:06.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:51:06.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:51:08.856 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-06-11T15:51:09.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:51:09.358 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-452.el9.x86_64"... 2024-06-11T15:51:09.358 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-06-11T15:51:09.373 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-452.el9.x86_64 2024-06-11T15:51:09.373 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-11T15:51:09.373 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T15:51:09.373 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-11T15:51:09.753 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-06-11T15:51:10.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:51:10.128 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-452.el9.x86_64"... 2024-06-11T15:51:10.128 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-06-11T15:51:10.143 INFO:teuthology.orchestra.run.smithi129.stdout:5.14.0-452.el9.x86_64 2024-06-11T15:51:10.143 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-11T15:51:10.143 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T15:51:10.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-11T15:51:10.374 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-06-11T15:51:10.375 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T15:51:10.476 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-06-11T15:51:10.523 DEBUG:teuthology.parallel:result is None 2024-06-11T15:51:11.144 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-06-11T15:51:11.144 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T15:51:11.210 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-06-11T15:51:11.250 DEBUG:teuthology.parallel:result is None 2024-06-11T15:51:22.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-06-11T15:51:37.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:51:37.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:51:38.137 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-06-11T15:51:38.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:51:38.624 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-452.el9.x86_64"... 2024-06-11T15:51:38.625 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-06-11T15:51:38.639 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-452.el9.x86_64 2024-06-11T15:51:38.639 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-11T15:51:38.639 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-11T15:51:38.639 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-11T15:51:39.640 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-06-11T15:51:39.641 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-11T15:51:39.721 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-06-11T15:51:39.754 DEBUG:teuthology.parallel:result is None 2024-06-11T15:51:39.755 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-11T15:51:39.763 INFO:teuthology.task.internal:Creating test directory... 2024-06-11T15:51:39.763 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T15:51:39.766 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T15:51:39.769 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T15:51:39.772 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-11T15:51:39.792 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-11T15:51:39.815 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-11T15:51:39.864 INFO:teuthology.task.internal:Creating archive directory... 2024-06-11T15:51:39.864 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T15:51:39.866 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T15:51:39.869 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T15:51:39.871 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-11T15:51:40.006 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-11T15:51:40.013 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-11T15:51:40.013 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T15:51:40.016 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T15:51:40.018 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T15:51:40.021 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-11T15:51:40.048 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.057 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.059 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.064 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.064 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.069 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.074 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.076 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-11T15:51:40.077 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-11T15:51:40.095 INFO:teuthology.task.internal:Configuring sudo... 2024-06-11T15:51:40.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T15:51:40.097 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T15:51:40.104 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T15:51:40.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-11T15:51:40.145 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-11T15:51:40.158 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-11T15:51:40.158 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T15:51:40.166 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T15:51:40.172 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T15:51:40.174 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-11T15:51:40.201 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.317 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:40.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:40.448 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:51:40.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T15:51:40.514 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.577 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.616 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:40.693 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:40.741 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:51:40.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T15:51:40.807 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:40.896 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:40.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:41.018 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:51:41.018 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T15:51:41.084 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:41.121 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-11T15:51:41.189 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:41.272 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-11T15:51:41.318 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:51:41.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-11T15:51:41.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-06-11T15:51:41.391 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-06-11T15:51:41.393 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-06-11T15:51:41.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-06-11T15:51:41.435 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T15:51:41.437 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T15:51:41.443 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T15:51:41.477 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T15:51:41.884 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-11T15:51:41.894 INFO:teuthology.task.internal:Starting timer... 2024-06-11T15:51:41.894 INFO:teuthology.run_tasks:Running task pcp... 2024-06-11T15:51:41.938 INFO:teuthology.run_tasks:Running task selinux... 2024-06-11T15:51:41.978 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-11T15:51:41.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-06-11T15:51:42.033 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-06-11T15:51:42.035 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-06-11T15:51:42.095 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-06-11T15:51:42.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-06-11T15:51:42.156 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-06-11T15:51:42.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-06-11T15:51:42.221 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-06-11T15:51:42.223 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-11T15:51:42.223 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-06-11T15:51:42.269 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-06-11T15:51:42.269 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-06-11T15:51:42.300 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-06-11T15:51:42.300 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-06-11T15:51:42.319 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-06-11T15:51:42.319 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-06-11T15:51:42.350 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-06-11T15:51:42.350 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-06-11T15:51:42.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T15:51:42.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:51:42.381 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T15:51:42.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:51:42.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T15:51:42.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:51:42.437 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T15:51:42.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:51:42.466 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-11T15:51:42.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-06-11T15:51:42.496 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-06-11T15:51:42.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-06-11T15:51:42.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-06-11T15:51:42.577 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-11T15:51:42.588 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-11T15:51:42.594 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-11T15:51:42.707 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-11T15:51:42.718 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-11T15:51:42.719 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi129.front.sepia.ceph.com,smithi163.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-11T15:56:24.261 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-06-11T15:56:24.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:56:24.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:56:24.342 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-06-11T15:56:24.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-06-11T15:56:24.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:56:24.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:56:24.504 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-06-11T15:56:24.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-06-11T15:56:24.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:56:24.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:56:24.664 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-06-11T15:56:24.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-06-11T15:56:24.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:56:24.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T15:56:24.817 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-06-11T15:56:24.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T15:56:24.906 INFO:teuthology.run_tasks:Running task clock... 2024-06-11T15:56:24.921 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-11T15:56:24.922 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T15:56:24.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T15:56:24.925 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T15:56:24.925 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T15:56:24.927 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T15:56:24.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T15:56:24.930 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-11T15:56:24.930 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T15:56:24.956 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-11T15:56:24.957 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-11T15:56:24.958 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-11T15:56:24.972 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-11T15:56:24.973 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-11T15:56:24.973 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-11T15:56:24.979 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-11T15:56:24.994 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-11T15:56:24.997 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-06-11T15:56:24.998 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-06-11T15:56:24.999 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-06-11T15:56:25.008 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-06-11T15:56:25.009 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-06-11T15:56:25.010 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-06-11T15:56:25.020 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-06-11T15:56:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-11T15:56:25.023 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-11T15:56:25.025 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-11T15:56:25.032 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-06-11T15:56:25.036 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-11T15:56:25.037 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-11T15:56:25.040 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-11T15:56:25.046 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-11T15:56:25.061 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-11T15:56:25.091 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-06-11T15:56:25.094 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-06-11T15:56:25.094 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.095 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.097 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T15:56:25.098 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-06-11T15:56:25.098 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.098 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.098 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.098 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.099 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T15:56:25.101 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-06-11T15:56:25.101 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.101 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.101 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.101 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.129 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.133 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T15:56:25.134 INFO:teuthology.run_tasks:Running task install... 2024-06-11T15:56:25.142 DEBUG:teuthology.task.install:project ceph 2024-06-11T15:56:25.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}} 2024-06-11T15:56:25.143 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'} 2024-06-11T15:56:25.143 INFO:teuthology.task.install:Using flavor: default 2024-06-11T15:56:25.148 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-11T15:56:25.148 INFO:teuthology.task.install:extra packages: [] 2024-06-11T15:56:25.149 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'tag': None, 'wait_for_package': False} 2024-06-11T15:56:25.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:56:25.151 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'tag': None, 'wait_for_package': False} 2024-06-11T15:56:25.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:56:25.152 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'tag': None, 'wait_for_package': False} 2024-06-11T15:56:25.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:56:25.153 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'tag': None, 'wait_for_package': False} 2024-06-11T15:56:25.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:56:25.297 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/ 2024-06-11T15:56:25.298 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2976.g3f51ea39 2024-06-11T15:56:25.307 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/ 2024-06-11T15:56:25.307 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2976.g3f51ea39 2024-06-11T15:56:25.390 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/ 2024-06-11T15:56:25.391 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2976.g3f51ea39 2024-06-11T15:56:25.409 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-11T15:56:25.410 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:56:25.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-11T15:56:25.413 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/ 2024-06-11T15:56:25.413 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2976.g3f51ea39 2024-06-11T15:56:25.441 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-06-11T15:56:25.441 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3f51ea3944d39ca13aa40153c9a4ee298306679d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-11T15:56:25.507 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-11T15:56:25.556 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-11T15:56:25.556 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:56:25.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-11T15:56:25.582 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-11T15:56:25.583 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-06-11T15:56:25.583 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3f51ea3944d39ca13aa40153c9a4ee298306679d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-11T15:56:25.611 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-11T15:56:25.611 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:56:25.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-11T15:56:25.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/3f51ea3944d39ca13aa40153c9a4ee298306679d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-11T15:56:25.639 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:56:25.639 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-11T15:56:25.641 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-06-11T15:56:25.641 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3f51ea3944d39ca13aa40153c9a4ee298306679d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-11T15:56:25.646 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-06-11T15:56:25.648 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-06-11T15:56:25.650 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-11T15:56:25.667 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-06-11T15:56:25.667 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3f51ea3944d39ca13aa40153c9a4ee298306679d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-11T15:56:25.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-11T15:56:25.727 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-11T15:56:25.732 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-11T15:56:25.782 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-11T15:56:25.792 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-06-11T15:56:25.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-06-11T15:56:25.808 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-11T15:56:25.846 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-06-11T15:56:25.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-06-11T15:56:25.872 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-06-11T15:56:25.873 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-06-11T15:56:25.890 INFO:teuthology.orchestra.run.smithi163.stdout:45 files removed 2024-06-11T15:56:25.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-06-11T15:56:26.019 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-06-11T15:56:26.046 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-06-11T15:56:26.085 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-06-11T15:56:26.111 INFO:teuthology.orchestra.run.smithi129.stdout:45 files removed 2024-06-11T15:56:26.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-06-11T15:56:26.138 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-06-11T15:56:26.714 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 254 kB/s | 83 kB 00:00 2024-06-11T15:56:26.739 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 152 kB/s | 83 kB 00:00 2024-06-11T15:56:26.782 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 181 kB/s | 83 kB 00:00 2024-06-11T15:56:26.896 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 173 kB/s | 83 kB 00:00 2024-06-11T15:56:27.448 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-06-11T15:56:27.506 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-06-11T15:56:27.608 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 15 kB/s | 11 kB 00:00 2024-06-11T15:56:27.687 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-06-11T15:56:28.132 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-06-11T15:56:28.174 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-06-11T15:56:28.349 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-06-11T15:56:28.371 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-06-11T15:56:29.142 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.1 MB 00:00 2024-06-11T15:56:29.343 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 8.5 MB/s | 8.1 MB 00:00 2024-06-11T15:56:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.1 MB 00:01 2024-06-11T15:56:29.982 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.1 MB 00:01 2024-06-11T15:56:31.060 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-06-11T15:56:31.453 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-06-11T15:56:31.825 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-11T15:56:35.368 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.2 MB 00:00 2024-06-11T15:56:36.192 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-06-11T15:56:36.437 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.2 MB 00:01 2024-06-11T15:56:36.802 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 17 kB 00:00 2024-06-11T15:56:37.656 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-06-11T15:56:37.717 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 17 kB 00:00 2024-06-11T15:56:38.121 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 17 kB 00:00 2024-06-11T15:56:38.995 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-06-11T15:56:39.057 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-06-11T15:56:42.836 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-06-11T15:56:44.229 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-06-11T15:56:44.334 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-11T15:56:45.195 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:45.196 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:45.262 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 6.6 k 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.4 M 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 890 k 2024-06-11T15:56:45.278 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 145 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 1.5 M 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 142 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 3.5 M 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 7.4 M 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 49 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 10 M 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 48 M 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 264 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 763 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-11T15:56:45.279 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 32 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 746 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 127 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 162 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 321 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 300 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 99 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 86 k 2024-06-11T15:56:45.280 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 170 k 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.4 M 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-06-11T15:56:45.281 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 21 M 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 32 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 2.4 M 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 249 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 4.7 M 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 17 M 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 16 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 25 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-11T15:56:45.282 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 163 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-11T15:56:45.283 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 502 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.3 M 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-11T15:56:45.284 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 45 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 135 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-11T15:56:45.285 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-11T15:56:45.286 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-11T15:56:45.287 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-11T15:56:45.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-11T15:56:45.289 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout:Install 135 Packages 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 7 Packages 2024-06-11T15:56:45.290 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:56:45.291 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 212 M 2024-06-11T15:56:45.291 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-06-11T15:56:46.029 INFO:teuthology.orchestra.run.smithi163.stdout:(1/142): ceph-19.0.0-2976.g3f51ea39.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-06-11T15:56:46.429 INFO:teuthology.orchestra.run.smithi163.stdout:(2/142): ceph-fuse-19.0.0-2976.g3f51ea39.el9.x8 2.2 MB/s | 890 kB 00:00 2024-06-11T15:56:46.555 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:46.555 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:46.622 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-06-11T15:56:46.640 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-06-11T15:56:46.640 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 6.6 k 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.4 M 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 890 k 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 145 k 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 1.5 M 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 142 k 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 3.5 M 2024-06-11T15:56:46.641 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 7.4 M 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 49 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 10 M 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 48 M 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 264 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 763 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 32 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 746 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 127 k 2024-06-11T15:56:46.642 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 162 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 321 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 300 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 99 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 86 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 170 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-11T15:56:46.643 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.4 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 21 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 32 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 2.4 M 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 249 k 2024-06-11T15:56:46.644 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 4.7 M 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 17 M 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 16 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 25 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 163 k 2024-06-11T15:56:46.645 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 502 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.3 M 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-11T15:56:46.646 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 45 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 135 k 2024-06-11T15:56:46.647 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-11T15:56:46.648 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-11T15:56:46.649 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-11T15:56:46.650 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-11T15:56:46.651 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:Install 135 Packages 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 7 Packages 2024-06-11T15:56:46.652 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:56:46.653 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 212 M 2024-06-11T15:56:46.653 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-06-11T15:56:46.670 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:46.670 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:56:46.737 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-06-11T15:56:46.757 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-06-11T15:56:46.757 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 6.6 k 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.4 M 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 890 k 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 145 k 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 1.5 M 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 142 k 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 3.5 M 2024-06-11T15:56:46.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 7.4 M 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 49 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 10 M 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 48 M 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 264 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 763 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 32 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 746 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 127 k 2024-06-11T15:56:46.759 INFO:teuthology.orchestra.run.smithi129.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 162 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 321 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 300 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 99 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 86 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 170 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-11T15:56:46.760 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.4 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 21 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 32 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 2.4 M 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 249 k 2024-06-11T15:56:46.761 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 4.7 M 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 17 M 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 16 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 25 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 163 k 2024-06-11T15:56:46.762 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 502 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.3 M 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-11T15:56:46.763 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 45 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 135 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-11T15:56:46.764 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-11T15:56:46.765 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-11T15:56:46.766 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-11T15:56:46.767 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-11T15:56:46.768 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:Installing weak dependencies: 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:======================================================================================= 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:Install 135 Packages 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 7 Packages 2024-06-11T15:56:46.769 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:56:46.770 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 212 M 2024-06-11T15:56:46.770 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-06-11T15:56:46.788 INFO:teuthology.orchestra.run.smithi163.stdout:(3/142): ceph-base-19.0.0-2976.g3f51ea39.el9.x8 5.4 MB/s | 5.4 MB 00:00 2024-06-11T15:56:46.867 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-06-11T15:56:47.080 INFO:teuthology.orchestra.run.smithi163.stdout:(4/142): ceph-mds-19.0.0-2976.g3f51ea39.el9.x86 8.1 MB/s | 2.4 MB 00:00 2024-06-11T15:56:47.222 INFO:teuthology.orchestra.run.smithi163.stdout:(5/142): ceph-immutable-object-cache-19.0.0-297 183 kB/s | 145 kB 00:00 2024-06-11T15:56:47.280 INFO:teuthology.orchestra.run.smithi163.stdout:(6/142): ceph-mgr-19.0.0-2976.g3f51ea39.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-06-11T15:56:47.522 INFO:teuthology.orchestra.run.smithi171.stdout:(1/142): ceph-19.0.0-2976.g3f51ea39.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-06-11T15:56:47.864 INFO:teuthology.orchestra.run.smithi163.stdout:(7/142): ceph-common-19.0.0-2976.g3f51ea39.el9. 10 MB/s | 21 MB 00:02 2024-06-11T15:56:47.869 INFO:teuthology.orchestra.run.smithi129.stdout:(1/142): ceph-19.0.0-2976.g3f51ea39.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-06-11T15:56:48.022 INFO:teuthology.orchestra.run.smithi171.stdout:(2/142): ceph-fuse-19.0.0-2976.g3f51ea39.el9.x8 1.7 MB/s | 890 kB 00:00 2024-06-11T15:56:48.156 INFO:teuthology.orchestra.run.smithi171.stdout:(3/142): ceph-immutable-object-cache-19.0.0-297 1.1 MB/s | 145 kB 00:00 2024-06-11T15:56:48.656 INFO:teuthology.orchestra.run.smithi171.stdout:(4/142): ceph-base-19.0.0-2976.g3f51ea39.el9.x8 3.6 MB/s | 5.4 MB 00:01 2024-06-11T15:56:48.823 INFO:teuthology.orchestra.run.smithi171.stdout:(5/142): ceph-mds-19.0.0-2976.g3f51ea39.el9.x86 3.5 MB/s | 2.4 MB 00:00 2024-06-11T15:56:48.856 INFO:teuthology.orchestra.run.smithi171.stdout:(6/142): ceph-mgr-19.0.0-2976.g3f51ea39.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-06-11T15:56:48.881 INFO:teuthology.orchestra.run.smithi163.stdout:(8/142): ceph-osd-19.0.0-2976.g3f51ea39.el9.x86 10 MB/s | 17 MB 00:01 2024-06-11T15:56:48.981 INFO:teuthology.orchestra.run.smithi163.stdout:(9/142): ceph-selinux-19.0.0-2976.g3f51ea39.el9 252 kB/s | 25 kB 00:00 2024-06-11T15:56:49.194 INFO:teuthology.orchestra.run.smithi129.stdout:(2/142): ceph-fuse-19.0.0-2976.g3f51ea39.el9.x8 672 kB/s | 890 kB 00:01 2024-06-11T15:56:49.403 INFO:teuthology.orchestra.run.smithi129.stdout:(3/142): ceph-immutable-object-cache-19.0.0-297 695 kB/s | 145 kB 00:00 2024-06-11T15:56:49.657 INFO:teuthology.orchestra.run.smithi171.stdout:(7/142): ceph-mon-19.0.0-2976.g3f51ea39.el9.x86 5.6 MB/s | 4.7 MB 00:00 2024-06-11T15:56:50.898 INFO:teuthology.orchestra.run.smithi163.stdout:(10/142): ceph-radosgw-19.0.0-2976.g3f51ea39.el 3.4 MB/s | 10 MB 00:03 2024-06-11T15:56:50.973 INFO:teuthology.orchestra.run.smithi163.stdout:(11/142): ceph-mon-19.0.0-2976.g3f51ea39.el9.x8 1.3 MB/s | 4.7 MB 00:03 2024-06-11T15:56:50.998 INFO:teuthology.orchestra.run.smithi163.stdout:(12/142): libcephfs-devel-19.0.0-2976.g3f51ea39 317 kB/s | 32 kB 00:00 2024-06-11T15:56:51.048 INFO:teuthology.orchestra.run.smithi171.stdout:(8/142): ceph-radosgw-19.0.0-2976.g3f51ea39.el9 7.4 MB/s | 10 MB 00:01 2024-06-11T15:56:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:(9/142): ceph-selinux-19.0.0-2976.g3f51ea39.el9 302 kB/s | 25 kB 00:00 2024-06-11T15:56:51.157 INFO:teuthology.orchestra.run.smithi163.stdout:(13/142): libcephsqlite-19.0.0-2976.g3f51ea39.e 1.0 MB/s | 163 kB 00:00 2024-06-11T15:56:51.258 INFO:teuthology.orchestra.run.smithi163.stdout:(14/142): librados-devel-19.0.0-2976.g3f51ea39. 1.2 MB/s | 127 kB 00:00 2024-06-11T15:56:51.566 INFO:teuthology.orchestra.run.smithi163.stdout:(15/142): libradosstriper1-19.0.0-2976.g3f51ea3 1.6 MB/s | 502 kB 00:00 2024-06-11T15:56:51.711 INFO:teuthology.orchestra.run.smithi129.stdout:(4/142): ceph-mds-19.0.0-2976.g3f51ea39.el9.x86 1.0 MB/s | 2.4 MB 00:02 2024-06-11T15:56:51.766 INFO:teuthology.orchestra.run.smithi163.stdout:(16/142): libcephfs2-19.0.0-2976.g3f51ea39.el9. 941 kB/s | 746 kB 00:00 2024-06-11T15:56:51.883 INFO:teuthology.orchestra.run.smithi163.stdout:(17/142): python3-ceph-argparse-19.0.0-2976.g3f 387 kB/s | 45 kB 00:00 2024-06-11T15:56:51.966 INFO:teuthology.orchestra.run.smithi171.stdout:(10/142): ceph-osd-19.0.0-2976.g3f51ea39.el9.x8 5.4 MB/s | 17 MB 00:03 2024-06-11T15:56:52.017 INFO:teuthology.orchestra.run.smithi163.stdout:(18/142): python3-ceph-common-19.0.0-2976.g3f51 1.0 MB/s | 135 kB 00:00 2024-06-11T15:56:52.091 INFO:teuthology.orchestra.run.smithi171.stdout:(11/142): libcephfs-devel-19.0.0-2976.g3f51ea39 254 kB/s | 32 kB 00:00 2024-06-11T15:56:52.259 INFO:teuthology.orchestra.run.smithi163.stdout:(19/142): python3-cephfs-19.0.0-2976.g3f51ea39. 671 kB/s | 162 kB 00:00 2024-06-11T15:56:52.301 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-06-11T15:56:52.324 INFO:teuthology.orchestra.run.smithi171.stdout:(12/142): libcephfs2-19.0.0-2976.g3f51ea39.el9. 3.1 MB/s | 746 kB 00:00 2024-06-11T15:56:52.425 INFO:teuthology.orchestra.run.smithi171.stdout:(13/142): libcephsqlite-19.0.0-2976.g3f51ea39.e 1.6 MB/s | 163 kB 00:00 2024-06-11T15:56:52.533 INFO:teuthology.orchestra.run.smithi171.stdout:(14/142): librados-devel-19.0.0-2976.g3f51ea39. 1.1 MB/s | 127 kB 00:00 2024-06-11T15:56:52.542 INFO:teuthology.orchestra.run.smithi163.stdout:(20/142): python3-rados-19.0.0-2976.g3f51ea39.e 1.1 MB/s | 321 kB 00:00 2024-06-11T15:56:52.709 INFO:teuthology.orchestra.run.smithi171.stdout:(15/142): libradosstriper1-19.0.0-2976.g3f51ea3 2.8 MB/s | 502 kB 00:00 2024-06-11T15:56:52.809 INFO:teuthology.orchestra.run.smithi163.stdout:(21/142): python3-rbd-19.0.0-2976.g3f51ea39.el9 1.1 MB/s | 300 kB 00:00 2024-06-11T15:56:52.969 INFO:teuthology.orchestra.run.smithi163.stdout:(22/142): python3-rgw-19.0.0-2976.g3f51ea39.el9 628 kB/s | 99 kB 00:00 2024-06-11T15:56:53.135 INFO:teuthology.orchestra.run.smithi163.stdout:(23/142): rbd-fuse-19.0.0-2976.g3f51ea39.el9.x8 513 kB/s | 86 kB 00:00 2024-06-11T15:56:53.228 INFO:teuthology.orchestra.run.smithi129.stdout:(5/142): ceph-mgr-19.0.0-2976.g3f51ea39.el9.x86 1.0 MB/s | 1.5 MB 00:01 2024-06-11T15:56:53.959 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 17 kB 00:00 2024-06-11T15:56:54.084 INFO:teuthology.orchestra.run.smithi171.stdout:(16/142): librgw2-19.0.0-2976.g3f51ea39.el9.x86 3.9 MB/s | 5.3 MB 00:01 2024-06-11T15:56:54.419 INFO:teuthology.orchestra.run.smithi163.stdout:(24/142): librgw2-19.0.0-2976.g3f51ea39.el9.x86 1.9 MB/s | 5.3 MB 00:02 2024-06-11T15:56:54.543 INFO:teuthology.orchestra.run.smithi171.stdout:(17/142): ceph-test-19.0.0-2976.g3f51ea39.el9.x 14 MB/s | 48 MB 00:03 2024-06-11T15:56:54.559 INFO:teuthology.orchestra.run.smithi171.stdout:(18/142): python3-ceph-argparse-19.0.0-2976.g3f 95 kB/s | 45 kB 00:00 2024-06-11T15:56:54.568 INFO:teuthology.orchestra.run.smithi163.stdout:(25/142): rbd-nbd-19.0.0-2976.g3f51ea39.el9.x86 1.1 MB/s | 170 kB 00:00 2024-06-11T15:56:54.635 INFO:teuthology.orchestra.run.smithi171.stdout:(19/142): python3-ceph-common-19.0.0-2976.g3f51 1.4 MB/s | 135 kB 00:00 2024-06-11T15:56:54.677 INFO:teuthology.orchestra.run.smithi163.stdout:(26/142): ceph-grafana-dashboards-19.0.0-2976.g 292 kB/s | 32 kB 00:00 2024-06-11T15:56:54.735 INFO:teuthology.orchestra.run.smithi171.stdout:(20/142): python3-rados-19.0.0-2976.g3f51ea39.e 3.1 MB/s | 321 kB 00:00 2024-06-11T15:56:54.760 INFO:teuthology.orchestra.run.smithi171.stdout:(21/142): python3-cephfs-19.0.0-2976.g3f51ea39. 809 kB/s | 162 kB 00:00 2024-06-11T15:56:54.786 INFO:teuthology.orchestra.run.smithi129.stdout:(6/142): ceph-base-19.0.0-2976.g3f51ea39.el9.x8 758 kB/s | 5.4 MB 00:07 2024-06-11T15:56:54.827 INFO:teuthology.orchestra.run.smithi171.stdout:(22/142): python3-rbd-19.0.0-2976.g3f51ea39.el9 3.2 MB/s | 300 kB 00:00 2024-06-11T15:56:54.844 INFO:teuthology.orchestra.run.smithi163.stdout:(27/142): ceph-mgr-cephadm-19.0.0-2976.g3f51ea3 854 kB/s | 142 kB 00:00 2024-06-11T15:56:54.861 INFO:teuthology.orchestra.run.smithi171.stdout:(23/142): python3-rgw-19.0.0-2976.g3f51ea39.el9 990 kB/s | 99 kB 00:00 2024-06-11T15:56:54.911 INFO:teuthology.orchestra.run.smithi171.stdout:(24/142): rbd-fuse-19.0.0-2976.g3f51ea39.el9.x8 1.0 MB/s | 86 kB 00:00 2024-06-11T15:56:55.037 INFO:teuthology.orchestra.run.smithi171.stdout:(25/142): rbd-nbd-19.0.0-2976.g3f51ea39.el9.x86 1.3 MB/s | 170 kB 00:00 2024-06-11T15:56:55.087 INFO:teuthology.orchestra.run.smithi171.stdout:(26/142): ceph-grafana-dashboards-19.0.0-2976.g 637 kB/s | 32 kB 00:00 2024-06-11T15:56:55.145 INFO:teuthology.orchestra.run.smithi171.stdout:(27/142): ceph-mgr-cephadm-19.0.0-2976.g3f51ea3 2.4 MB/s | 142 kB 00:00 2024-06-11T15:56:55.170 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-06-11T15:56:55.219 INFO:teuthology.orchestra.run.smithi163.stdout:(28/142): rbd-mirror-19.0.0-2976.g3f51ea39.el9. 1.5 MB/s | 3.1 MB 00:02 2024-06-11T15:56:55.438 INFO:teuthology.orchestra.run.smithi171.stdout:(28/142): ceph-mgr-dashboard-19.0.0-2976.g3f51e 12 MB/s | 3.5 MB 00:00 2024-06-11T15:56:55.546 INFO:teuthology.orchestra.run.smithi171.stdout:(29/142): rbd-mirror-19.0.0-2976.g3f51ea39.el9. 4.5 MB/s | 3.1 MB 00:00 2024-06-11T15:56:55.671 INFO:teuthology.orchestra.run.smithi171.stdout:(30/142): ceph-mgr-modules-core-19.0.0-2976.g3f 1.9 MB/s | 249 kB 00:00 2024-06-11T15:56:55.805 INFO:teuthology.orchestra.run.smithi171.stdout:(31/142): ceph-mgr-rook-19.0.0-2976.g3f51ea39.e 370 kB/s | 49 kB 00:00 2024-06-11T15:56:55.955 INFO:teuthology.orchestra.run.smithi171.stdout:(32/142): ceph-mgr-diskprediction-local-19.0.0- 14 MB/s | 7.4 MB 00:00 2024-06-11T15:56:55.981 INFO:teuthology.orchestra.run.smithi171.stdout:(33/142): ceph-prometheus-alerts-19.0.0-2976.g3 94 kB/s | 16 kB 00:00 2024-06-11T15:56:56.064 INFO:teuthology.orchestra.run.smithi171.stdout:(34/142): ceph-volume-19.0.0-2976.g3f51ea39.el9 2.4 MB/s | 264 kB 00:00 2024-06-11T15:56:56.104 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.119 INFO:teuthology.orchestra.run.smithi163.stdout:(29/142): ceph-mgr-dashboard-19.0.0-2976.g3f51e 2.8 MB/s | 3.5 MB 00:01 2024-06-11T15:56:56.165 INFO:teuthology.orchestra.run.smithi171.stdout:(35/142): cephadm-19.0.0-2976.g3f51ea39.el9.noa 4.1 MB/s | 763 kB 00:00 2024-06-11T15:56:56.165 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.186 INFO:teuthology.orchestra.run.smithi163.stdout:(30/142): ceph-mgr-modules-core-19.0.0-2976.g3f 3.7 MB/s | 249 kB 00:00 2024-06-11T15:56:56.206 INFO:teuthology.orchestra.run.smithi171.stdout:(36/142): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-06-11T15:56:56.207 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.237 INFO:teuthology.orchestra.run.smithi163.stdout:(31/142): ceph-mgr-rook-19.0.0-2976.g3f51ea39.e 987 kB/s | 49 kB 00:00 2024-06-11T15:56:56.281 INFO:teuthology.orchestra.run.smithi171.stdout:(37/142): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-06-11T15:56:56.295 INFO:teuthology.orchestra.run.smithi163.stdout:(32/142): ceph-prometheus-alerts-19.0.0-2976.g3 283 kB/s | 16 kB 00:00 2024-06-11T15:56:56.349 INFO:teuthology.orchestra.run.smithi171.stdout:(38/142): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-06-11T15:56:56.371 INFO:teuthology.orchestra.run.smithi163.stdout:(33/142): ceph-volume-19.0.0-2976.g3f51ea39.el9 3.4 MB/s | 264 kB 00:00 2024-06-11T15:56:56.374 INFO:teuthology.orchestra.run.smithi171.stdout:(39/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-11T15:56:56.416 INFO:teuthology.orchestra.run.smithi171.stdout:(40/142): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-06-11T15:56:56.450 INFO:teuthology.orchestra.run.smithi171.stdout:(41/142): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-06-11T15:56:56.504 INFO:teuthology.orchestra.run.smithi163.stdout:(34/142): cephadm-19.0.0-2976.g3f51ea39.el9.noa 5.6 MB/s | 763 kB 00:00 2024-06-11T15:56:56.508 INFO:teuthology.orchestra.run.smithi171.stdout:(42/142): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-11T15:56:56.544 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.567 INFO:teuthology.orchestra.run.smithi171.stdout:(43/142): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-11T15:56:56.568 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.586 INFO:teuthology.orchestra.run.smithi129.stdout:(7/142): ceph-mon-19.0.0-2976.g3f51ea39.el9.x86 1.4 MB/s | 4.7 MB 00:03 2024-06-11T15:56:56.609 INFO:teuthology.orchestra.run.smithi171.stdout:(44/142): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-06-11T15:56:56.611 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.621 INFO:teuthology.orchestra.run.smithi163.stdout:(35/142): fuse-2.9.9-15.el9.x86_64.rpm 689 kB/s | 80 kB 00:00 2024-06-11T15:56:56.622 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.705 INFO:teuthology.orchestra.run.smithi163.stdout:(36/142): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-06-11T15:56:56.706 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:56.747 INFO:teuthology.orchestra.run.smithi163.stdout:(37/142): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-06-11T15:56:56.789 INFO:teuthology.orchestra.run.smithi163.stdout:(38/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-11T15:56:56.847 INFO:teuthology.orchestra.run.smithi163.stdout:(39/142): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-06-11T15:56:56.882 INFO:teuthology.orchestra.run.smithi163.stdout:(40/142): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-06-11T15:56:56.923 INFO:teuthology.orchestra.run.smithi163.stdout:(41/142): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-06-11T15:56:56.965 INFO:teuthology.orchestra.run.smithi163.stdout:(42/142): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-06-11T15:56:57.007 INFO:teuthology.orchestra.run.smithi163.stdout:(43/142): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-06-11T15:56:57.008 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-11T15:56:57.324 INFO:teuthology.orchestra.run.smithi163.stdout:(44/142): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-06-11T15:56:57.326 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:57.824 INFO:teuthology.orchestra.run.smithi163.stdout:(45/142): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-06-11T15:56:57.858 INFO:teuthology.orchestra.run.smithi163.stdout:(46/142): automake-1.16.2-8.el9.noarch.rpm 810 kB/s | 689 kB 00:00 2024-06-11T15:56:57.858 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:57.859 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:57.967 INFO:teuthology.orchestra.run.smithi163.stdout:(47/142): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-06-11T15:56:57.992 INFO:teuthology.orchestra.run.smithi163.stdout:(48/142): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-06-11T15:56:58.100 INFO:teuthology.orchestra.run.smithi163.stdout:(49/142): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-06-11T15:56:58.126 INFO:teuthology.orchestra.run.smithi163.stdout:(50/142): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-06-11T15:56:58.151 INFO:teuthology.orchestra.run.smithi171.stdout:(45/142): automake-1.16.2-8.el9.noarch.rpm 435 kB/s | 689 kB 00:01 2024-06-11T15:56:58.152 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:56:58.343 INFO:teuthology.orchestra.run.smithi163.stdout:(51/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-06-11T15:56:58.368 INFO:teuthology.orchestra.run.smithi163.stdout:(52/142): flexiblas-openblas-openmp-3.0.4-8.el9 75 kB/s | 18 kB 00:00 2024-06-11T15:56:58.443 INFO:teuthology.orchestra.run.smithi163.stdout:(53/142): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-06-11T15:56:58.460 INFO:teuthology.orchestra.run.smithi163.stdout:(54/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-06-11T15:56:58.476 INFO:teuthology.orchestra.run.smithi171.stdout:(46/142): bison-3.7.4-5.el9.x86_64.rpm 505 kB/s | 943 kB 00:01 2024-06-11T15:56:58.544 INFO:teuthology.orchestra.run.smithi163.stdout:(55/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-06-11T15:56:58.586 INFO:teuthology.orchestra.run.smithi163.stdout:(56/142): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-06-11T15:56:58.643 INFO:teuthology.orchestra.run.smithi171.stdout:(47/142): boost-program-options-1.75.0-8.el9.x8 217 kB/s | 107 kB 00:00 2024-06-11T15:56:58.661 INFO:teuthology.orchestra.run.smithi163.stdout:(57/142): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-06-11T15:56:58.686 INFO:teuthology.orchestra.run.smithi163.stdout:(58/142): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-06-11T15:56:58.762 INFO:teuthology.orchestra.run.smithi163.stdout:(59/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-06-11T15:56:58.795 INFO:teuthology.orchestra.run.smithi163.stdout:(60/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-06-11T15:56:58.862 INFO:teuthology.orchestra.run.smithi163.stdout:(61/142): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-06-11T15:56:58.904 INFO:teuthology.orchestra.run.smithi163.stdout:(62/142): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 35 kB 00:00 2024-06-11T15:56:58.960 INFO:teuthology.orchestra.run.smithi171.stdout:(48/142): ceph-common-19.0.0-2976.g3f51ea39.el9 1.8 MB/s | 21 MB 00:11 2024-06-11T15:56:58.977 INFO:teuthology.orchestra.run.smithi171.stdout:(49/142): elfutils-libelf-devel-0.191-4.el9.x86 43 kB/s | 22 kB 00:00 2024-06-11T15:56:59.154 INFO:teuthology.orchestra.run.smithi163.stdout:(63/142): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-06-11T15:56:59.219 INFO:teuthology.orchestra.run.smithi171.stdout:(50/142): flexiblas-3.0.4-8.el9.x86_64.rpm 127 kB/s | 33 kB 00:00 2024-06-11T15:56:59.371 INFO:teuthology.orchestra.run.smithi163.stdout:(64/142): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-06-11T15:56:59.394 INFO:teuthology.orchestra.run.smithi171.stdout:(51/142): flex-2.6.4-9.el9.x86_64.rpm 418 kB/s | 313 kB 00:00 2024-06-11T15:56:59.405 INFO:teuthology.orchestra.run.smithi163.stdout:(65/142): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-06-11T15:56:59.486 INFO:teuthology.orchestra.run.smithi171.stdout:(52/142): flexiblas-openblas-openmp-3.0.4-8.el9 68 kB/s | 18 kB 00:00 2024-06-11T15:56:59.586 INFO:teuthology.orchestra.run.smithi171.stdout:(53/142): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-06-11T15:56:59.689 INFO:teuthology.orchestra.run.smithi163.stdout:(66/142): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-06-11T15:56:59.720 INFO:teuthology.orchestra.run.smithi129.stdout:(8/142): ceph-radosgw-19.0.0-2976.g3f51ea39.el9 3.3 MB/s | 10 MB 00:03 2024-06-11T15:56:59.722 INFO:teuthology.orchestra.run.smithi163.stdout:(67/142): python3-devel-3.9.18-3.el9.x86_64.rpm 770 kB/s | 244 kB 00:00 2024-06-11T15:56:59.789 INFO:teuthology.orchestra.run.smithi163.stdout:(68/142): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-06-11T15:56:59.823 INFO:teuthology.orchestra.run.smithi163.stdout:(69/142): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-06-11T15:56:59.890 INFO:teuthology.orchestra.run.smithi163.stdout:(70/142): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-06-11T15:56:59.920 INFO:teuthology.orchestra.run.smithi129.stdout:(9/142): ceph-common-19.0.0-2976.g3f51ea39.el9. 1.7 MB/s | 21 MB 00:12 2024-06-11T15:56:59.923 INFO:teuthology.orchestra.run.smithi163.stdout:(71/142): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-06-11T15:56:59.945 INFO:teuthology.orchestra.run.smithi129.stdout:(10/142): ceph-selinux-19.0.0-2976.g3f51ea39.el 112 kB/s | 25 kB 00:00 2024-06-11T15:56:59.970 INFO:teuthology.orchestra.run.smithi171.stdout:(54/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 118 kB/s | 45 kB 00:00 2024-06-11T15:56:59.991 INFO:teuthology.orchestra.run.smithi163.stdout:(72/142): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-06-11T15:57:00.004 INFO:teuthology.orchestra.run.smithi129.stdout:(11/142): libcephfs-devel-19.0.0-2976.g3f51ea39 545 kB/s | 32 kB 00:00 2024-06-11T15:57:00.020 INFO:teuthology.orchestra.run.smithi171.stdout:(55/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-06-11T15:57:00.121 INFO:teuthology.orchestra.run.smithi171.stdout:(56/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 252 kB/s | 160 kB 00:00 2024-06-11T15:57:00.191 INFO:teuthology.orchestra.run.smithi163.stdout:(73/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-06-11T15:57:00.216 INFO:teuthology.orchestra.run.smithi163.stdout:(74/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-06-11T15:57:00.237 INFO:teuthology.orchestra.run.smithi129.stdout:(12/142): ceph-osd-19.0.0-2976.g3f51ea39.el9.x8 3.1 MB/s | 17 MB 00:05 2024-06-11T15:57:00.300 INFO:teuthology.orchestra.run.smithi163.stdout:(75/142): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-06-11T15:57:00.312 INFO:teuthology.orchestra.run.smithi129.stdout:(13/142): libcephsqlite-19.0.0-2976.g3f51ea39.e 2.1 MB/s | 163 kB 00:00 2024-06-11T15:57:00.325 INFO:teuthology.orchestra.run.smithi163.stdout:(76/142): python3-packaging-20.9-5.el9.noarch.r 709 kB/s | 77 kB 00:00 2024-06-11T15:57:00.354 INFO:teuthology.orchestra.run.smithi129.stdout:(14/142): libcephfs2-19.0.0-2976.g3f51ea39.el9. 2.1 MB/s | 746 kB 00:00 2024-06-11T15:57:00.380 INFO:teuthology.orchestra.run.smithi129.stdout:(15/142): librados-devel-19.0.0-2976.g3f51ea39. 1.9 MB/s | 127 kB 00:00 2024-06-11T15:57:00.387 INFO:teuthology.orchestra.run.smithi171.stdout:(57/142): libuuid-devel-2.37.4-18.el9.x86_64.rp 95 kB/s | 25 kB 00:00 2024-06-11T15:57:00.400 INFO:teuthology.orchestra.run.smithi163.stdout:(77/142): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-06-11T15:57:00.426 INFO:teuthology.orchestra.run.smithi163.stdout:(78/142): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-06-11T15:57:00.468 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-06-11T15:57:00.501 INFO:teuthology.orchestra.run.smithi163.stdout:(79/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-06-11T15:57:00.505 INFO:teuthology.orchestra.run.smithi129.stdout:(16/142): libradosstriper1-19.0.0-2976.g3f51ea3 3.3 MB/s | 502 kB 00:00 2024-06-11T15:57:00.526 INFO:teuthology.orchestra.run.smithi163.stdout:(80/142): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-06-11T15:57:00.572 INFO:teuthology.orchestra.run.smithi129.stdout:(17/142): python3-ceph-argparse-19.0.0-2976.g3f 678 kB/s | 45 kB 00:00 2024-06-11T15:57:00.602 INFO:teuthology.orchestra.run.smithi163.stdout:(81/142): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-06-11T15:57:00.627 INFO:teuthology.orchestra.run.smithi163.stdout:(82/142): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-06-11T15:57:00.630 INFO:teuthology.orchestra.run.smithi129.stdout:(18/142): python3-ceph-common-19.0.0-2976.g3f51 2.3 MB/s | 135 kB 00:00 2024-06-11T15:57:00.714 INFO:teuthology.orchestra.run.smithi129.stdout:(19/142): python3-cephfs-19.0.0-2976.g3f51ea39. 1.9 MB/s | 162 kB 00:00 2024-06-11T15:57:00.780 INFO:teuthology.orchestra.run.smithi171.stdout:(58/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 121 kB/s | 47 kB 00:00 2024-06-11T15:57:00.802 INFO:teuthology.orchestra.run.smithi163.stdout:(83/142): python3-toml-0.10.2-6.el9.noarch.rpm 238 kB/s | 42 kB 00:00 2024-06-11T15:57:00.848 INFO:teuthology.orchestra.run.smithi129.stdout:(20/142): python3-rados-19.0.0-2976.g3f51ea39.e 2.3 MB/s | 321 kB 00:00 2024-06-11T15:57:01.032 INFO:teuthology.orchestra.run.smithi129.stdout:(21/142): python3-rbd-19.0.0-2976.g3f51ea39.el9 1.6 MB/s | 300 kB 00:00 2024-06-11T15:57:01.115 INFO:teuthology.orchestra.run.smithi129.stdout:(22/142): python3-rgw-19.0.0-2976.g3f51ea39.el9 1.2 MB/s | 99 kB 00:00 2024-06-11T15:57:01.199 INFO:teuthology.orchestra.run.smithi129.stdout:(23/142): rbd-fuse-19.0.0-2976.g3f51ea39.el9.x8 1.0 MB/s | 86 kB 00:00 2024-06-11T15:57:01.438 INFO:teuthology.orchestra.run.smithi171.stdout:(59/142): librdkafka-1.6.1-102.el9.x86_64.rpm 451 kB/s | 662 kB 00:01 2024-06-11T15:57:01.471 INFO:teuthology.orchestra.run.smithi171.stdout:(60/142): libtool-2.4.6-45.el9.x86_64.rpm 401 kB/s | 582 kB 00:01 2024-06-11T15:57:01.539 INFO:teuthology.orchestra.run.smithi171.stdout:(61/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 385 kB/s | 292 kB 00:00 2024-06-11T15:57:01.670 INFO:teuthology.orchestra.run.smithi163.stdout:(84/142): ceph-test-19.0.0-2976.g3f51ea39.el9.x 3.8 MB/s | 48 MB 00:12 2024-06-11T15:57:01.703 INFO:teuthology.orchestra.run.smithi163.stdout:(85/142): qatlib-24.02.0-1.el9.x86_64.rpm 246 kB/s | 221 kB 00:00 2024-06-11T15:57:01.739 INFO:teuthology.orchestra.run.smithi171.stdout:(62/142): openblas-0.3.21-2.el9.x86_64.rpm 132 kB/s | 35 kB 00:00 2024-06-11T15:57:01.862 INFO:teuthology.orchestra.run.smithi163.stdout:(86/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-06-11T15:57:01.887 INFO:teuthology.orchestra.run.smithi163.stdout:(87/142): qatlib-service-24.02.0-1.el9.x86_64.r 166 kB/s | 36 kB 00:00 2024-06-11T15:57:01.912 INFO:teuthology.orchestra.run.smithi163.stdout:(88/142): qatzip-libs-1.2.0-1.el9.x86_64.rpm 228 kB/s | 47 kB 00:00 2024-06-11T15:57:01.970 INFO:teuthology.orchestra.run.smithi163.stdout:(89/142): socat-1.7.4.1-5.el9.x86_64.rpm 2.8 MB/s | 305 kB 00:00 2024-06-11T15:57:01.991 INFO:teuthology.orchestra.run.smithi129.stdout:(24/142): librgw2-19.0.0-2976.g3f51ea39.el9.x86 3.3 MB/s | 5.3 MB 00:01 2024-06-11T15:57:02.012 INFO:teuthology.orchestra.run.smithi163.stdout:(90/142): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 936 kB/s | 94 kB 00:00 2024-06-11T15:57:02.029 INFO:teuthology.orchestra.run.smithi163.stdout:(91/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 544 kB/s | 64 kB 00:00 2024-06-11T15:57:02.030 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:02.030 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:02.050 INFO:teuthology.orchestra.run.smithi129.stdout:(25/142): rbd-mirror-19.0.0-2976.g3f51ea39.el9. 3.6 MB/s | 3.1 MB 00:00 2024-06-11T15:57:02.071 INFO:teuthology.orchestra.run.smithi163.stdout:(92/142): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-06-11T15:57:02.113 INFO:teuthology.orchestra.run.smithi163.stdout:(93/142): abseil-cpp-20211102.0-3.el9.x86_64.rp 13 MB/s | 548 kB 00:00 2024-06-11T15:57:02.114 INFO:teuthology.orchestra.run.smithi171.stdout:(63/142): lua-5.4.4-4.el9.x86_64.rpm 279 kB/s | 188 kB 00:00 2024-06-11T15:57:02.116 INFO:teuthology.orchestra.run.smithi129.stdout:(26/142): rbd-nbd-19.0.0-2976.g3f51ea39.el9.x86 1.3 MB/s | 170 kB 00:00 2024-06-11T15:57:02.138 INFO:teuthology.orchestra.run.smithi163.stdout:(94/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 12 MB/s | 309 kB 00:00 2024-06-11T15:57:02.142 INFO:teuthology.orchestra.run.smithi129.stdout:(27/142): ceph-grafana-dashboards-19.0.0-2976.g 345 kB/s | 32 kB 00:00 2024-06-11T15:57:02.155 INFO:teuthology.orchestra.run.smithi163.stdout:(95/142): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-06-11T15:57:02.184 INFO:teuthology.orchestra.run.smithi129.stdout:(28/142): ceph-mgr-cephadm-19.0.0-2976.g3f51ea3 2.1 MB/s | 142 kB 00:00 2024-06-11T15:57:02.281 INFO:teuthology.orchestra.run.smithi163.stdout:(96/142): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-06-11T15:57:02.306 INFO:teuthology.orchestra.run.smithi163.stdout:(97/142): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-11T15:57:02.331 INFO:teuthology.orchestra.run.smithi163.stdout:(98/142): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-06-11T15:57:02.357 INFO:teuthology.orchestra.run.smithi163.stdout:(99/142): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-06-11T15:57:02.409 INFO:teuthology.orchestra.run.smithi163.stdout:(100/142): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-06-11T15:57:02.432 INFO:teuthology.orchestra.run.smithi163.stdout:(101/142): libunwind-1.6.2-1.el9.x86_64.rpm 670 kB/s | 67 kB 00:00 2024-06-11T15:57:02.457 INFO:teuthology.orchestra.run.smithi163.stdout:(102/142): parquet-libs-9.0.0-11.el9.x86_64.rpm 17 MB/s | 839 kB 00:00 2024-06-11T15:57:02.483 INFO:teuthology.orchestra.run.smithi163.stdout:(103/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-11T15:57:02.508 INFO:teuthology.orchestra.run.smithi163.stdout:(104/142): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-11T15:57:02.533 INFO:teuthology.orchestra.run.smithi163.stdout:(105/142): python3-certifi-2021.10.8-2.el9.noar 605 kB/s | 15 kB 00:00 2024-06-11T15:57:02.560 INFO:teuthology.orchestra.run.smithi163.stdout:(106/142): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-06-11T15:57:02.592 INFO:teuthology.orchestra.run.smithi163.stdout:(107/142): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-06-11T15:57:02.618 INFO:teuthology.orchestra.run.smithi163.stdout:(108/142): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-06-11T15:57:02.643 INFO:teuthology.orchestra.run.smithi163.stdout:(109/142): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-11T15:57:02.668 INFO:teuthology.orchestra.run.smithi163.stdout:(110/142): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-06-11T15:57:02.693 INFO:teuthology.orchestra.run.smithi163.stdout:(111/142): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-06-11T15:57:02.719 INFO:teuthology.orchestra.run.smithi163.stdout:(112/142): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-06-11T15:57:02.744 INFO:teuthology.orchestra.run.smithi163.stdout:(113/142): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-06-11T15:57:02.769 INFO:teuthology.orchestra.run.smithi163.stdout:(114/142): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-06-11T15:57:02.794 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:57:02.794 INFO:teuthology.orchestra.run.smithi163.stdout:(115/142): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-06-11T15:57:02.795 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-11T15:57:02.845 INFO:teuthology.orchestra.run.smithi163.stdout:(116/142): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-06-11T15:57:02.862 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-06-11T15:57:02.870 INFO:teuthology.orchestra.run.smithi163.stdout:(117/142): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-11T15:57:02.883 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-06-11T15:57:02.883 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-06-11T15:57:02.883 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-06-11T15:57:02.883 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 6.6 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.4 M 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 890 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 145 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 1.5 M 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 142 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 3.5 M 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 7.4 M 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 49 k 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 10 M 2024-06-11T15:57:02.884 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 48 M 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 264 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 763 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 32 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 746 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 127 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 162 k 2024-06-11T15:57:02.885 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 321 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 300 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 99 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 86 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 170 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.4 M 2024-06-11T15:57:02.886 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 3.1 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 21 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 32 k 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 2.4 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 249 k 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 4.7 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 17 M 2024-06-11T15:57:02.887 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2976.g3f51ea39.el9 ceph-noarch 16 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 25 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 163 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-11T15:57:02.888 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 502 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 5.3 M 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-11T15:57:02.889 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 45 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.0.0-2976.g3f51ea39.el9 ceph 135 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-11T15:57:02.890 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-11T15:57:02.891 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-11T15:57:02.892 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-11T15:57:02.893 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-11T15:57:02.894 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout:Install 135 Packages 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 7 Packages 2024-06-11T15:57:02.895 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:02.896 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 212 M 2024-06-11T15:57:02.896 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-06-11T15:57:02.912 INFO:teuthology.orchestra.run.smithi163.stdout:(118/142): python3-grpcio-1.46.7-10.el9.x86_64. 6.9 MB/s | 2.0 MB 00:00 2024-06-11T15:57:02.929 INFO:teuthology.orchestra.run.smithi163.stdout:(119/142): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-06-11T15:57:02.954 INFO:teuthology.orchestra.run.smithi163.stdout:(120/142): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-06-11T15:57:02.988 INFO:teuthology.orchestra.run.smithi163.stdout:(121/142): protobuf-compiler-3.14.0-13.el9.x86_ 901 kB/s | 863 kB 00:00 2024-06-11T15:57:03.013 INFO:teuthology.orchestra.run.smithi163.stdout:(122/142): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-06-11T15:57:03.055 INFO:teuthology.orchestra.run.smithi163.stdout:(123/142): python3-repoze-lru-0.7-16.el9.noarch 2.1 MB/s | 31 kB 00:00 2024-06-11T15:57:03.089 INFO:teuthology.orchestra.run.smithi163.stdout:(124/142): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-06-11T15:57:03.114 INFO:teuthology.orchestra.run.smithi163.stdout:(125/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 714 kB/s | 90 kB 00:00 2024-06-11T15:57:03.117 INFO:teuthology.orchestra.run.smithi129.stdout:(29/142): ceph-mgr-dashboard-19.0.0-2976.g3f51e 3.6 MB/s | 3.5 MB 00:00 2024-06-11T15:57:03.131 INFO:teuthology.orchestra.run.smithi163.stdout:(126/142): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-06-11T15:57:03.156 INFO:teuthology.orchestra.run.smithi163.stdout:(127/142): python3-routes-2.5.1-5.el9.noarch.rp 1.9 MB/s | 188 kB 00:00 2024-06-11T15:57:03.182 INFO:teuthology.orchestra.run.smithi163.stdout:(128/142): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-06-11T15:57:03.207 INFO:teuthology.orchestra.run.smithi163.stdout:(129/142): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-06-11T15:57:03.232 INFO:teuthology.orchestra.run.smithi163.stdout:(130/142): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-06-11T15:57:03.251 INFO:teuthology.orchestra.run.smithi129.stdout:(30/142): ceph-mgr-modules-core-19.0.0-2976.g3f 1.8 MB/s | 249 kB 00:00 2024-06-11T15:57:03.257 INFO:teuthology.orchestra.run.smithi163.stdout:(131/142): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-06-11T15:57:03.283 INFO:teuthology.orchestra.run.smithi163.stdout:(132/142): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-06-11T15:57:03.308 INFO:teuthology.orchestra.run.smithi163.stdout:(133/142): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-11T15:57:03.326 INFO:teuthology.orchestra.run.smithi129.stdout:(31/142): ceph-mgr-rook-19.0.0-2976.g3f51ea39.e 658 kB/s | 49 kB 00:00 2024-06-11T15:57:03.333 INFO:teuthology.orchestra.run.smithi163.stdout:(134/142): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-06-11T15:57:03.401 INFO:teuthology.orchestra.run.smithi129.stdout:(32/142): ceph-prometheus-alerts-19.0.0-2976.g3 219 kB/s | 16 kB 00:00 2024-06-11T15:57:03.434 INFO:teuthology.orchestra.run.smithi163.stdout:(135/142): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-06-11T15:57:03.484 INFO:teuthology.orchestra.run.smithi163.stdout:(136/142): elfutils-debuginfod-client-0.191-4.e 771 kB/s | 37 kB 00:00 2024-06-11T15:57:03.543 INFO:teuthology.orchestra.run.smithi129.stdout:(33/142): ceph-volume-19.0.0-2976.g3f51ea39.el9 1.8 MB/s | 264 kB 00:00 2024-06-11T15:57:03.551 INFO:teuthology.orchestra.run.smithi163.stdout:(137/142): elfutils-libelf-0.191-4.el9.x86_64.r 3.0 MB/s | 207 kB 00:00 2024-06-11T15:57:03.601 INFO:teuthology.orchestra.run.smithi163.stdout:(138/142): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-06-11T15:57:03.668 INFO:teuthology.orchestra.run.smithi163.stdout:(139/142): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-06-11T15:57:03.743 INFO:teuthology.orchestra.run.smithi163.stdout:(140/142): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-06-11T15:57:03.827 INFO:teuthology.orchestra.run.smithi129.stdout:(34/142): cephadm-19.0.0-2976.g3f51ea39.el9.noa 2.6 MB/s | 763 kB 00:00 2024-06-11T15:57:03.867 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:03.877 INFO:teuthology.orchestra.run.smithi163.stdout:(141/142): librbd1-19.0.0-2976.g3f51ea39.el9.x8 5.8 MB/s | 3.1 MB 00:00 2024-06-11T15:57:03.969 INFO:teuthology.orchestra.run.smithi089.stdout:(1/142): ceph-19.0.0-2976.g3f51ea39.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-06-11T15:57:04.061 INFO:teuthology.orchestra.run.smithi163.stdout:(142/142): librados2-19.0.0-2976.g3f51ea39.el9. 4.5 MB/s | 3.4 MB 00:00 2024-06-11T15:57:04.064 INFO:teuthology.orchestra.run.smithi171.stdout:(64/142): protobuf-3.14.0-13.el9.x86_64.rpm 530 kB/s | 1.0 MB 00:01 2024-06-11T15:57:04.067 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:57:04.067 INFO:teuthology.orchestra.run.smithi163.stdout:Total 11 MB/s | 212 MB 00:18 2024-06-11T15:57:04.186 INFO:teuthology.orchestra.run.smithi089.stdout:(2/142): ceph-fuse-19.0.0-2976.g3f51ea39.el9.x8 4.0 MB/s | 890 kB 00:00 2024-06-11T15:57:04.261 INFO:teuthology.orchestra.run.smithi089.stdout:(3/142): ceph-immutable-object-cache-19.0.0-297 1.9 MB/s | 145 kB 00:00 2024-06-11T15:57:04.302 INFO:teuthology.orchestra.run.smithi129.stdout:(35/142): fuse-2.9.9-15.el9.x86_64.rpm 169 kB/s | 80 kB 00:00 2024-06-11T15:57:04.303 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:04.387 INFO:teuthology.orchestra.run.smithi089.stdout:(4/142): ceph-base-19.0.0-2976.g3f51ea39.el9.x8 9.2 MB/s | 5.4 MB 00:00 2024-06-11T15:57:04.578 INFO:teuthology.orchestra.run.smithi089.stdout:(5/142): ceph-mds-19.0.0-2976.g3f51ea39.el9.x86 7.5 MB/s | 2.4 MB 00:00 2024-06-11T15:57:04.612 INFO:teuthology.orchestra.run.smithi089.stdout:(6/142): ceph-mgr-19.0.0-2976.g3f51ea39.el9.x86 6.6 MB/s | 1.5 MB 00:00 2024-06-11T15:57:04.894 INFO:teuthology.orchestra.run.smithi129.stdout:(36/142): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-06-11T15:57:04.919 INFO:teuthology.orchestra.run.smithi129.stdout:(37/142): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-06-11T15:57:04.920 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:04.921 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] python3-cffi-1.14.5-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-cffi-1.14.5-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:05.053 INFO:teuthology.orchestra.run.smithi129.stdout:(38/142): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-06-11T15:57:05.086 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-06-11T15:57:05.213 INFO:teuthology.orchestra.run.smithi089.stdout:(7/142): ceph-mon-19.0.0-2976.g3f51ea39.el9.x86 7.4 MB/s | 4.7 MB 00:00 2024-06-11T15:57:05.229 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-06-11T15:57:05.229 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-06-11T15:57:05.412 INFO:teuthology.orchestra.run.smithi129.stdout:(39/142): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-06-11T15:57:05.423 INFO:teuthology.orchestra.run.smithi171.stdout:(65/142): openblas-openmp-0.3.21-2.el9.x86_64.r 1.2 MB/s | 4.7 MB 00:03 2024-06-11T15:57:05.554 INFO:teuthology.orchestra.run.smithi129.stdout:(40/142): python3-ply-3.11-14.el9.noarch.rpm 753 kB/s | 106 kB 00:00 2024-06-11T15:57:05.612 INFO:teuthology.orchestra.run.smithi129.stdout:(41/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 366 kB/s | 253 kB 00:00 2024-06-11T15:57:05.687 INFO:teuthology.orchestra.run.smithi129.stdout:(42/142): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-06-11T15:57:05.738 INFO:teuthology.orchestra.run.smithi129.stdout:(43/142): python3-requests-2.25.1-8.el9.noarch. 996 kB/s | 125 kB 00:00 2024-06-11T15:57:05.739 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-11T15:57:05.756 INFO:teuthology.orchestra.run.smithi171.stdout:(66/142): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:04 2024-06-11T15:57:05.771 INFO:teuthology.orchestra.run.smithi089.stdout:(8/142): ceph-osd-19.0.0-2976.g3f51ea39.el9.x86 14 MB/s | 17 MB 00:01 2024-06-11T15:57:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:(44/142): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-06-11T15:57:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:05.829 INFO:teuthology.orchestra.run.smithi089.stdout:(9/142): ceph-selinux-19.0.0-2976.g3f51ea39.el9 431 kB/s | 25 kB 00:00 2024-06-11T15:57:05.930 INFO:teuthology.orchestra.run.smithi129.stdout:(45/142): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-06-11T15:57:05.931 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:05.980 INFO:teuthology.orchestra.run.smithi129.stdout:(46/142): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-06-11T15:57:06.022 INFO:teuthology.orchestra.run.smithi129.stdout:(47/142): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-06-11T15:57:06.073 INFO:teuthology.orchestra.run.smithi129.stdout:(48/142): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-06-11T15:57:06.098 INFO:teuthology.orchestra.run.smithi129.stdout:(49/142): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-06-11T15:57:06.123 INFO:teuthology.orchestra.run.smithi129.stdout:(50/142): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-06-11T15:57:06.174 INFO:teuthology.orchestra.run.smithi129.stdout:(51/142): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-06-11T15:57:06.190 INFO:teuthology.orchestra.run.smithi171.stdout:(67/142): python3-devel-3.9.18-3.el9.x86_64.rpm 318 kB/s | 244 kB 00:00 2024-06-11T15:57:06.224 INFO:teuthology.orchestra.run.smithi129.stdout:(52/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-06-11T15:57:06.250 INFO:teuthology.orchestra.run.smithi129.stdout:(53/142): libaio-devel-0.3.111-13.el9.x86_64.rp 147 kB/s | 11 kB 00:00 2024-06-11T15:57:06.275 INFO:teuthology.orchestra.run.smithi129.stdout:(54/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-11T15:57:06.300 INFO:teuthology.orchestra.run.smithi129.stdout:(55/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-06-11T15:57:06.342 INFO:teuthology.orchestra.run.smithi129.stdout:(56/142): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-11T15:57:06.384 INFO:teuthology.orchestra.run.smithi129.stdout:(57/142): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-06-11T15:57:06.434 INFO:teuthology.orchestra.run.smithi129.stdout:(58/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-06-11T15:57:06.466 INFO:teuthology.orchestra.run.smithi171.stdout:(68/142): python3-jsonpatch-1.21-16.el9.noarch. 93 kB/s | 26 kB 00:00 2024-06-11T15:57:06.484 INFO:teuthology.orchestra.run.smithi129.stdout:(59/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-11T15:57:06.510 INFO:teuthology.orchestra.run.smithi171.stdout:(69/142): python3-jinja2-2.11.3-6.el9.noarch.rp 331 kB/s | 248 kB 00:00 2024-06-11T15:57:06.535 INFO:teuthology.orchestra.run.smithi129.stdout:(60/142): libuuid-devel-2.37.4-18.el9.x86_64.rp 132 kB/s | 25 kB 00:00 2024-06-11T15:57:06.546 INFO:teuthology.orchestra.run.smithi089.stdout:(10/142): ceph-radosgw-19.0.0-2976.g3f51ea39.el 7.7 MB/s | 10 MB 00:01 2024-06-11T15:57:06.577 INFO:teuthology.orchestra.run.smithi129.stdout:(61/142): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-06-11T15:57:06.602 INFO:teuthology.orchestra.run.smithi129.stdout:(62/142): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-06-11T15:57:06.630 INFO:teuthology.orchestra.run.smithi089.stdout:(11/142): libcephfs-devel-19.0.0-2976.g3f51ea39 381 kB/s | 32 kB 00:00 2024-06-11T15:57:06.733 INFO:teuthology.orchestra.run.smithi171.stdout:(70/142): python3-jsonpointer-2.0-4.el9.noarch. 72 kB/s | 19 kB 00:00 2024-06-11T15:57:06.777 INFO:teuthology.orchestra.run.smithi129.stdout:(63/142): openssl-devel-3.2.1-1.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-06-11T15:57:06.805 INFO:teuthology.orchestra.run.smithi089.stdout:(12/142): libcephfs2-19.0.0-2976.g3f51ea39.el9. 4.2 MB/s | 746 kB 00:00 2024-06-11T15:57:06.889 INFO:teuthology.orchestra.run.smithi089.stdout:(13/142): libcephsqlite-19.0.0-2976.g3f51ea39.e 1.9 MB/s | 163 kB 00:00 2024-06-11T15:57:06.933 INFO:teuthology.orchestra.run.smithi171.stdout:(71/142): python3-mako-1.1.4-6.el9.noarch.rpm 405 kB/s | 172 kB 00:00 2024-06-11T15:57:06.964 INFO:teuthology.orchestra.run.smithi089.stdout:(14/142): librados-devel-19.0.0-2976.g3f51ea39. 1.7 MB/s | 127 kB 00:00 2024-06-11T15:57:07.000 INFO:teuthology.orchestra.run.smithi171.stdout:(72/142): python3-markupsafe-1.1.1-12.el9.x86_6 130 kB/s | 35 kB 00:00 2024-06-11T15:57:07.056 INFO:teuthology.orchestra.run.smithi089.stdout:(15/142): libradosstriper1-19.0.0-2976.g3f51ea3 5.3 MB/s | 502 kB 00:00 2024-06-11T15:57:07.070 INFO:teuthology.orchestra.run.smithi129.stdout:(64/142): openblas-openmp-0.3.21-2.el9.x86_64.r 9.6 MB/s | 4.7 MB 00:00 2024-06-11T15:57:07.128 INFO:teuthology.orchestra.run.smithi129.stdout:(65/142): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-06-11T15:57:07.286 INFO:teuthology.orchestra.run.smithi129.stdout:(66/142): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 6.0 MB 00:00 2024-06-11T15:57:07.370 INFO:teuthology.orchestra.run.smithi129.stdout:(67/142): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-06-11T15:57:07.371 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-06-11T15:57:07.372 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-06-11T15:57:07.420 INFO:teuthology.orchestra.run.smithi129.stdout:(68/142): python3-devel-3.9.18-3.el9.x86_64.rpm 836 kB/s | 244 kB 00:00 2024-06-11T15:57:07.496 INFO:teuthology.orchestra.run.smithi129.stdout:(69/142): python3-jsonpatch-1.21-16.el9.noarch. 204 kB/s | 26 kB 00:00 2024-06-11T15:57:07.546 INFO:teuthology.orchestra.run.smithi129.stdout:(70/142): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-11T15:57:07.588 INFO:teuthology.orchestra.run.smithi129.stdout:(71/142): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-06-11T15:57:07.613 INFO:teuthology.orchestra.run.smithi129.stdout:(72/142): python3-jsonpointer-2.0-4.el9.noarch. 99 kB/s | 19 kB 00:00 2024-06-11T15:57:07.667 INFO:teuthology.orchestra.run.smithi171.stdout:(73/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 376 kB/s | 250 kB 00:00 2024-06-11T15:57:07.722 INFO:teuthology.orchestra.run.smithi129.stdout:(73/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-06-11T15:57:07.847 INFO:teuthology.orchestra.run.smithi129.stdout:(74/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-06-11T15:57:07.872 INFO:teuthology.orchestra.run.smithi129.stdout:(75/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-06-11T15:57:07.906 INFO:teuthology.orchestra.run.smithi089.stdout:(16/142): librgw2-19.0.0-2976.g3f51ea39.el9.x86 6.3 MB/s | 5.3 MB 00:00 2024-06-11T15:57:07.914 INFO:teuthology.orchestra.run.smithi129.stdout:(76/142): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-06-11T15:57:07.940 INFO:teuthology.orchestra.run.smithi129.stdout:(77/142): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-06-11T15:57:07.982 INFO:teuthology.orchestra.run.smithi089.stdout:(17/142): python3-ceph-argparse-19.0.0-2976.g3f 602 kB/s | 45 kB 00:00 2024-06-11T15:57:07.990 INFO:teuthology.orchestra.run.smithi129.stdout:(78/142): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-06-11T15:57:08.015 INFO:teuthology.orchestra.run.smithi129.stdout:(79/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-06-11T15:57:08.057 INFO:teuthology.orchestra.run.smithi089.stdout:(18/142): python3-ceph-common-19.0.0-2976.g3f51 1.8 MB/s | 135 kB 00:00 2024-06-11T15:57:08.066 INFO:teuthology.orchestra.run.smithi129.stdout:(80/142): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-06-11T15:57:08.091 INFO:teuthology.orchestra.run.smithi129.stdout:(81/142): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-06-11T15:57:08.132 INFO:teuthology.orchestra.run.smithi089.stdout:(19/142): python3-cephfs-19.0.0-2976.g3f51ea39. 2.1 MB/s | 162 kB 00:00 2024-06-11T15:57:08.150 INFO:teuthology.orchestra.run.smithi129.stdout:(82/142): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-06-11T15:57:08.224 INFO:teuthology.orchestra.run.smithi089.stdout:(20/142): python3-rados-19.0.0-2976.g3f51ea39.e 3.4 MB/s | 321 kB 00:00 2024-06-11T15:57:08.242 INFO:teuthology.orchestra.run.smithi171.stdout:(74/142): python3-oauthlib-3.1.1-5.el9.noarch.r 386 kB/s | 222 kB 00:00 2024-06-11T15:57:08.300 INFO:teuthology.orchestra.run.smithi129.stdout:(83/142): python3-toml-0.10.2-6.el9.noarch.rpm 278 kB/s | 42 kB 00:00 2024-06-11T15:57:08.308 INFO:teuthology.orchestra.run.smithi089.stdout:(21/142): python3-rbd-19.0.0-2976.g3f51ea39.el9 3.5 MB/s | 300 kB 00:00 2024-06-11T15:57:08.392 INFO:teuthology.orchestra.run.smithi089.stdout:(22/142): python3-rgw-19.0.0-2976.g3f51ea39.el9 1.2 MB/s | 99 kB 00:00 2024-06-11T15:57:08.400 INFO:teuthology.orchestra.run.smithi129.stdout:(84/142): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-06-11T15:57:08.467 INFO:teuthology.orchestra.run.smithi089.stdout:(23/142): rbd-fuse-19.0.0-2976.g3f51ea39.el9.x8 1.1 MB/s | 86 kB 00:00 2024-06-11T15:57:08.467 INFO:teuthology.orchestra.run.smithi129.stdout:(85/142): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-06-11T15:57:08.468 INFO:teuthology.orchestra.run.smithi171.stdout:(75/142): python3-babel-2.9.1-2.el9.noarch.rpm 1.4 MB/s | 6.0 MB 00:04 2024-06-11T15:57:08.542 INFO:teuthology.orchestra.run.smithi129.stdout:(86/142): qatzip-libs-1.2.0-1.el9.x86_64.rpm 633 kB/s | 47 kB 00:00 2024-06-11T15:57:08.593 INFO:teuthology.orchestra.run.smithi171.stdout:(76/142): python3-packaging-20.9-5.el9.noarch.r 220 kB/s | 77 kB 00:00 2024-06-11T15:57:08.609 INFO:teuthology.orchestra.run.smithi129.stdout:(87/142): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-06-11T15:57:08.810 INFO:teuthology.orchestra.run.smithi171.stdout:(77/142): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-06-11T15:57:08.942 INFO:teuthology.orchestra.run.smithi089.stdout:(24/142): ceph-test-19.0.0-2976.g3f51ea39.el9.x 16 MB/s | 48 MB 00:03 2024-06-11T15:57:09.009 INFO:teuthology.orchestra.run.smithi089.stdout:(25/142): rbd-mirror-19.0.0-2976.g3f51ea39.el9. 5.7 MB/s | 3.1 MB 00:00 2024-06-11T15:57:09.034 INFO:teuthology.orchestra.run.smithi089.stdout:(26/142): rbd-nbd-19.0.0-2976.g3f51ea39.el9.x86 1.8 MB/s | 170 kB 00:00 2024-06-11T15:57:09.052 INFO:teuthology.orchestra.run.smithi089.stdout:(27/142): ceph-grafana-dashboards-19.0.0-2976.g 759 kB/s | 32 kB 00:00 2024-06-11T15:57:09.068 INFO:teuthology.orchestra.run.smithi129.stdout:(88/142): ceph-test-19.0.0-2976.g3f51ea39.el9.x 5.3 MB/s | 48 MB 00:09 2024-06-11T15:57:09.085 INFO:teuthology.orchestra.run.smithi129.stdout:(89/142): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 197 kB/s | 94 kB 00:00 2024-06-11T15:57:09.085 INFO:teuthology.orchestra.run.smithi089.stdout:(28/142): ceph-mgr-cephadm-19.0.0-2976.g3f51ea3 2.8 MB/s | 142 kB 00:00 2024-06-11T15:57:09.277 INFO:teuthology.orchestra.run.smithi129.stdout:(90/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-06-11T15:57:09.302 INFO:teuthology.orchestra.run.smithi129.stdout:(91/142): zlib-devel-1.2.11-41.el9.x86_64.rpm 207 kB/s | 45 kB 00:00 2024-06-11T15:57:09.328 INFO:teuthology.orchestra.run.smithi129.stdout:(92/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-06-11T15:57:09.328 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:09.328 INFO:teuthology.orchestra.run.smithi129.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:09.335 INFO:teuthology.orchestra.run.smithi171.stdout:(78/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 302 kB/s | 159 kB 00:00 2024-06-11T15:57:09.369 INFO:teuthology.orchestra.run.smithi129.stdout:(93/142): abseil-cpp-20211102.0-3.el9.x86_64.rp 13 MB/s | 548 kB 00:00 2024-06-11T15:57:09.403 INFO:teuthology.orchestra.run.smithi129.stdout:(94/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 9.0 MB/s | 309 kB 00:00 2024-06-11T15:57:09.410 INFO:teuthology.orchestra.run.smithi171.stdout:(79/142): python3-protobuf-3.14.0-13.el9.noarch 330 kB/s | 269 kB 00:00 2024-06-11T15:57:09.430 INFO:teuthology.orchestra.run.smithi129.stdout:(95/142): grpc-data-1.46.7-10.el9.noarch.rpm 737 kB/s | 19 kB 00:00 2024-06-11T15:57:09.444 INFO:teuthology.orchestra.run.smithi089.stdout:(29/142): ceph-mgr-dashboard-19.0.0-2976.g3f51e 9.0 MB/s | 3.5 MB 00:00 2024-06-11T15:57:09.479 INFO:teuthology.orchestra.run.smithi129.stdout:(96/142): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-06-11T15:57:09.545 INFO:teuthology.orchestra.run.smithi129.stdout:(97/142): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-06-11T15:57:09.561 INFO:teuthology.orchestra.run.smithi089.stdout:(30/142): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-06-11T15:57:09.606 INFO:teuthology.orchestra.run.smithi089.stdout:(31/142): ceph-mgr-modules-core-19.0.0-2976.g3f 1.5 MB/s | 249 kB 00:00 2024-06-11T15:57:09.621 INFO:teuthology.orchestra.run.smithi129.stdout:(98/142): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-06-11T15:57:09.628 INFO:teuthology.orchestra.run.smithi089.stdout:(32/142): ceph-mgr-rook-19.0.0-2976.g3f51ea39.e 737 kB/s | 49 kB 00:00 2024-06-11T15:57:09.645 INFO:teuthology.orchestra.run.smithi089.stdout:(33/142): ceph-prometheus-alerts-19.0.0-2976.g3 430 kB/s | 16 kB 00:00 2024-06-11T15:57:09.646 INFO:teuthology.orchestra.run.smithi129.stdout:(99/142): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-06-11T15:57:09.671 INFO:teuthology.orchestra.run.smithi129.stdout:(100/142): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-11T15:57:09.679 INFO:teuthology.orchestra.run.smithi089.stdout:(34/142): ceph-volume-19.0.0-2976.g3f51ea39.el9 5.1 MB/s | 264 kB 00:00 2024-06-11T15:57:09.696 INFO:teuthology.orchestra.run.smithi129.stdout:(101/142): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-06-11T15:57:09.738 INFO:teuthology.orchestra.run.smithi129.stdout:(102/142): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-06-11T15:57:09.745 INFO:teuthology.orchestra.run.smithi089.stdout:(35/142): cephadm-19.0.0-2976.g3f51ea39.el9.noa 7.4 MB/s | 763 kB 00:00 2024-06-11T15:57:09.749 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:09.752 INFO:teuthology.orchestra.run.smithi171.stdout:(80/142): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-06-11T15:57:09.764 INFO:teuthology.orchestra.run.smithi129.stdout:(103/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-11T15:57:09.786 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:09.789 INFO:teuthology.orchestra.run.smithi129.stdout:(104/142): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-11T15:57:09.814 INFO:teuthology.orchestra.run.smithi129.stdout:(105/142): python3-certifi-2021.10.8-2.el9.noar 603 kB/s | 15 kB 00:00 2024-06-11T15:57:09.848 INFO:teuthology.orchestra.run.smithi129.stdout:(106/142): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-06-11T15:57:09.861 INFO:teuthology.orchestra.run.smithi171.stdout:(81/142): python3-pyasn1-modules-0.4.8-6.el9.no 530 kB/s | 279 kB 00:00 2024-06-11T15:57:09.882 INFO:teuthology.orchestra.run.smithi129.stdout:(107/142): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-06-11T15:57:09.907 INFO:teuthology.orchestra.run.smithi129.stdout:(108/142): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-06-11T15:57:09.958 INFO:teuthology.orchestra.run.smithi129.stdout:(109/142): python3-google-auth-2.29.0-2.el9.noa 2.6 MB/s | 205 kB 00:00 2024-06-11T15:57:09.971 INFO:teuthology.orchestra.run.smithi089.stdout:(36/142): fuse-2.9.9-15.el9.x86_64.rpm 275 kB/s | 80 kB 00:00 2024-06-11T15:57:09.972 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:09.991 INFO:teuthology.orchestra.run.smithi129.stdout:(110/142): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-06-11T15:57:10.008 INFO:teuthology.orchestra.run.smithi129.stdout:(111/142): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-06-11T15:57:10.033 INFO:teuthology.orchestra.run.smithi129.stdout:(112/142): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-06-11T15:57:10.050 INFO:teuthology.orchestra.run.smithi129.stdout:(113/142): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-06-11T15:57:10.067 INFO:teuthology.orchestra.run.smithi129.stdout:(114/142): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-06-11T15:57:10.084 INFO:teuthology.orchestra.run.smithi129.stdout:(115/142): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-06-11T15:57:10.103 INFO:teuthology.orchestra.run.smithi171.stdout:(82/142): python3-requests-oauthlib-1.3.0-12.el 153 kB/s | 54 kB 00:00 2024-06-11T15:57:10.109 INFO:teuthology.orchestra.run.smithi129.stdout:(116/142): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-06-11T15:57:10.130 INFO:teuthology.orchestra.run.smithi089.stdout:(37/142): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-06-11T15:57:10.134 INFO:teuthology.orchestra.run.smithi129.stdout:(117/142): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-11T15:57:10.160 INFO:teuthology.orchestra.run.smithi129.stdout:(118/142): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-11T15:57:10.185 INFO:teuthology.orchestra.run.smithi129.stdout:(119/142): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-11T15:57:10.227 INFO:teuthology.orchestra.run.smithi129.stdout:(120/142): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-06-11T15:57:10.252 INFO:teuthology.orchestra.run.smithi129.stdout:(121/142): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-06-11T15:57:10.278 INFO:teuthology.orchestra.run.smithi129.stdout:(122/142): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-06-11T15:57:10.303 INFO:teuthology.orchestra.run.smithi129.stdout:(123/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-06-11T15:57:10.313 INFO:teuthology.orchestra.run.smithi089.stdout:(38/142): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-06-11T15:57:10.328 INFO:teuthology.orchestra.run.smithi129.stdout:(124/142): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-06-11T15:57:10.338 INFO:teuthology.orchestra.run.smithi089.stdout:(39/142): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-06-11T15:57:10.353 INFO:teuthology.orchestra.run.smithi129.stdout:(125/142): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-11T15:57:10.378 INFO:teuthology.orchestra.run.smithi171.stdout:(83/142): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-06-11T15:57:10.379 INFO:teuthology.orchestra.run.smithi129.stdout:(126/142): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-06-11T15:57:10.404 INFO:teuthology.orchestra.run.smithi129.stdout:(127/142): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-11T15:57:10.429 INFO:teuthology.orchestra.run.smithi129.stdout:(128/142): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-11T15:57:10.430 INFO:teuthology.orchestra.run.smithi089.stdout:(40/142): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-06-11T15:57:10.455 INFO:teuthology.orchestra.run.smithi129.stdout:(129/142): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-06-11T15:57:10.480 INFO:teuthology.orchestra.run.smithi129.stdout:(130/142): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-11T15:57:10.530 INFO:teuthology.orchestra.run.smithi129.stdout:(131/142): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-06-11T15:57:10.531 INFO:teuthology.orchestra.run.smithi089.stdout:(41/142): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-06-11T15:57:10.555 INFO:teuthology.orchestra.run.smithi129.stdout:(132/142): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-06-11T15:57:10.581 INFO:teuthology.orchestra.run.smithi129.stdout:(133/142): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-11T15:57:10.606 INFO:teuthology.orchestra.run.smithi129.stdout:(134/142): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-06-11T15:57:10.631 INFO:teuthology.orchestra.run.smithi089.stdout:(42/142): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-06-11T15:57:10.636 INFO:teuthology.orchestra.run.smithi171.stdout:(84/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.4 MB/s | 5.1 MB 00:03 2024-06-11T15:57:10.648 INFO:teuthology.orchestra.run.smithi129.stdout:(135/142): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-06-11T15:57:10.773 INFO:teuthology.orchestra.run.smithi089.stdout:(43/142): python3-urllib3-1.26.5-5.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-06-11T15:57:10.774 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-11T15:57:10.823 INFO:teuthology.orchestra.run.smithi129.stdout:(136/142): elfutils-debuginfod-client-0.191-4.e 210 kB/s | 37 kB 00:00 2024-06-11T15:57:10.878 INFO:teuthology.orchestra.run.smithi171.stdout:(85/142): qatlib-24.02.0-1.el9.x86_64.rpm 441 kB/s | 221 kB 00:00 2024-06-11T15:57:10.904 INFO:teuthology.orchestra.run.smithi171.stdout:(86/142): qatlib-service-24.02.0-1.el9.x86_64.r 134 kB/s | 36 kB 00:00 2024-06-11T15:57:10.965 INFO:teuthology.orchestra.run.smithi089.stdout:(44/142): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-06-11T15:57:10.966 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:11.057 INFO:teuthology.orchestra.run.smithi089.stdout:(45/142): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-06-11T15:57:11.058 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:11.090 INFO:teuthology.orchestra.run.smithi129.stdout:(137/142): elfutils-libelf-0.191-4.el9.x86_64.r 776 kB/s | 207 kB 00:00 2024-06-11T15:57:11.140 INFO:teuthology.orchestra.run.smithi129.stdout:(138/142): librbd1-19.0.0-2976.g3f51ea39.el9.x8 5.9 MB/s | 3.1 MB 00:00 2024-06-11T15:57:11.141 INFO:teuthology.orchestra.run.smithi089.stdout:(46/142): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-06-11T15:57:11.191 INFO:teuthology.orchestra.run.smithi089.stdout:(47/142): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-06-11T15:57:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:(87/142): qatzip-libs-1.2.0-1.el9.x86_64.rpm 132 kB/s | 47 kB 00:00 2024-06-11T15:57:11.274 INFO:teuthology.orchestra.run.smithi129.stdout:(139/142): elfutils-libs-0.191-4.el9.x86_64.rpm 1.4 MB/s | 260 kB 00:00 2024-06-11T15:57:11.275 INFO:teuthology.orchestra.run.smithi089.stdout:(48/142): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-06-11T15:57:11.308 INFO:teuthology.orchestra.run.smithi089.stdout:(49/142): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-06-11T15:57:11.333 INFO:teuthology.orchestra.run.smithi089.stdout:(50/142): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-06-11T15:57:11.392 INFO:teuthology.orchestra.run.smithi089.stdout:(51/142): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-06-11T15:57:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:(88/142): socat-1.7.4.1-5.el9.x86_64.rpm 599 kB/s | 305 kB 00:00 2024-06-11T15:57:11.442 INFO:teuthology.orchestra.run.smithi089.stdout:(52/142): libaio-devel-0.3.111-13.el9.x86_64.rp 224 kB/s | 11 kB 00:00 2024-06-11T15:57:11.474 INFO:teuthology.orchestra.run.smithi129.stdout:(140/142): librados2-19.0.0-2976.g3f51ea39.el9. 3.8 MB/s | 3.4 MB 00:00 2024-06-11T15:57:11.501 INFO:teuthology.orchestra.run.smithi089.stdout:(53/142): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-11T15:57:11.551 INFO:teuthology.orchestra.run.smithi089.stdout:(54/142): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-06-11T15:57:11.688 INFO:teuthology.orchestra.run.smithi171.stdout:(89/142): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 208 kB/s | 94 kB 00:00 2024-06-11T15:57:11.743 INFO:teuthology.orchestra.run.smithi089.stdout:(55/142): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-06-11T15:57:11.763 INFO:teuthology.orchestra.run.smithi171.stdout:(90/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-06-11T15:57:11.775 INFO:teuthology.orchestra.run.smithi129.stdout:(141/142): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.8 MB/s | 2.4 MB 00:00 2024-06-11T15:57:11.803 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:11.925 INFO:teuthology.orchestra.run.smithi129.stdout:(142/142): openssl-3.2.1-1.el9.x86_64.rpm 1.7 MB/s | 1.3 MB 00:00 2024-06-11T15:57:11.931 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:57:11.931 INFO:teuthology.orchestra.run.smithi129.stdout:Total 8.4 MB/s | 212 MB 00:25 2024-06-11T15:57:12.064 INFO:teuthology.orchestra.run.smithi171.stdout:(91/142): zlib-devel-1.2.11-41.el9.x86_64.rpm 119 kB/s | 45 kB 00:00 2024-06-11T15:57:12.064 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:(56/142): libtool-2.4.6-45.el9.x86_64.rpm 1.3 MB/s | 582 kB 00:00 2024-06-11T15:57:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:(57/142): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-06-11T15:57:12.306 INFO:teuthology.orchestra.run.smithi171.stdout:(92/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-06-11T15:57:12.319 INFO:teuthology.orchestra.run.smithi089.stdout:(58/142): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-06-11T15:57:12.331 INFO:teuthology.orchestra.run.smithi171.stdout:(93/142): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-06-11T15:57:12.398 INFO:teuthology.orchestra.run.smithi171.stdout:(94/142): abseil-cpp-20211102.0-3.el9.x86_64.rp 5.8 MB/s | 548 kB 00:00 2024-06-11T15:57:12.423 INFO:teuthology.orchestra.run.smithi171.stdout:(95/142): grpc-data-1.46.7-10.el9.noarch.rpm 859 kB/s | 19 kB 00:00 2024-06-11T15:57:12.428 INFO:teuthology.orchestra.run.smithi089.stdout:(59/142): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-06-11T15:57:12.462 INFO:teuthology.orchestra.run.smithi089.stdout:(60/142): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-06-11T15:57:12.465 INFO:teuthology.orchestra.run.smithi171.stdout:(96/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 MB/s | 309 kB 00:00 2024-06-11T15:57:12.490 INFO:teuthology.orchestra.run.smithi171.stdout:(97/142): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-11T15:57:12.512 INFO:teuthology.orchestra.run.smithi089.stdout:(61/142): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-06-11T15:57:12.515 INFO:teuthology.orchestra.run.smithi171.stdout:(98/142): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-11T15:57:12.533 INFO:teuthology.orchestra.run.smithi171.stdout:(99/142): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-06-11T15:57:12.537 INFO:teuthology.orchestra.run.smithi089.stdout:(62/142): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-06-11T15:57:12.566 INFO:teuthology.orchestra.run.smithi171.stdout:(100/142): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-06-11T15:57:12.650 INFO:teuthology.orchestra.run.smithi171.stdout:(101/142): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-06-11T15:57:12.684 INFO:teuthology.orchestra.run.smithi171.stdout:(102/142): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-06-11T15:57:12.709 INFO:teuthology.orchestra.run.smithi171.stdout:(103/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-11T15:57:12.743 INFO:teuthology.orchestra.run.smithi171.stdout:(104/142): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-06-11T15:57:12.768 INFO:teuthology.orchestra.run.smithi171.stdout:(105/142): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-06-11T15:57:12.826 INFO:teuthology.orchestra.run.smithi171.stdout:(106/142): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-06-11T15:57:12.852 INFO:teuthology.orchestra.run.smithi171.stdout:(107/142): python3-cheroot-8.6.0-4.el9.noarch.r 3.0 MB/s | 172 kB 00:00 2024-06-11T15:57:12.877 INFO:teuthology.orchestra.run.smithi171.stdout:(108/142): python3-certifi-2021.10.8-2.el9.noar 112 kB/s | 15 kB 00:00 2024-06-11T15:57:12.902 INFO:teuthology.orchestra.run.smithi171.stdout:(109/142): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-11T15:57:12.928 INFO:teuthology.orchestra.run.smithi171.stdout:(110/142): python3-cherrypy-18.6.1-2.el9.noarch 3.6 MB/s | 358 kB 00:00 2024-06-11T15:57:12.953 INFO:teuthology.orchestra.run.smithi171.stdout:(111/142): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-06-11T15:57:12.966 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-06-11T15:57:12.971 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-06-11T15:57:12.978 INFO:teuthology.orchestra.run.smithi171.stdout:(112/142): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-06-11T15:57:12.995 INFO:teuthology.orchestra.run.smithi171.stdout:(113/142): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-06-11T15:57:13.012 INFO:teuthology.orchestra.run.smithi171.stdout:(114/142): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2024-06-11T15:57:13.029 INFO:teuthology.orchestra.run.smithi171.stdout:(115/142): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-06-11T15:57:13.040 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/149 2024-06-11T15:57:13.046 INFO:teuthology.orchestra.run.smithi171.stdout:(116/142): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-06-11T15:57:13.063 INFO:teuthology.orchestra.run.smithi171.stdout:(117/142): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-06-11T15:57:13.078 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/149 2024-06-11T15:57:13.088 INFO:teuthology.orchestra.run.smithi171.stdout:(118/142): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-11T15:57:13.110 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-06-11T15:57:13.110 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-06-11T15:57:13.114 INFO:teuthology.orchestra.run.smithi171.stdout:(119/142): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-11T15:57:13.133 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/149 2024-06-11T15:57:13.147 INFO:teuthology.orchestra.run.smithi171.stdout:(120/142): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-06-11T15:57:13.173 INFO:teuthology.orchestra.run.smithi171.stdout:(121/142): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-06-11T15:57:13.174 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/149 2024-06-11T15:57:13.198 INFO:teuthology.orchestra.run.smithi171.stdout:(122/142): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-06-11T15:57:13.199 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/149 2024-06-11T15:57:13.223 INFO:teuthology.orchestra.run.smithi171.stdout:(123/142): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-06-11T15:57:13.249 INFO:teuthology.orchestra.run.smithi171.stdout:(124/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-11T15:57:13.252 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/149 2024-06-11T15:57:13.274 INFO:teuthology.orchestra.run.smithi171.stdout:(125/142): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-11T15:57:13.299 INFO:teuthology.orchestra.run.smithi171.stdout:(126/142): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-06-11T15:57:13.316 INFO:teuthology.orchestra.run.smithi171.stdout:(127/142): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-06-11T15:57:13.342 INFO:teuthology.orchestra.run.smithi171.stdout:(128/142): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-06-11T15:57:13.367 INFO:teuthology.orchestra.run.smithi171.stdout:(129/142): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-06-11T15:57:13.417 INFO:teuthology.orchestra.run.smithi171.stdout:(130/142): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-06-11T15:57:13.442 INFO:teuthology.orchestra.run.smithi171.stdout:(131/142): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-06-11T15:57:13.459 INFO:teuthology.orchestra.run.smithi171.stdout:(132/142): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-06-11T15:57:13.484 INFO:teuthology.orchestra.run.smithi171.stdout:(133/142): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-06-11T15:57:13.518 INFO:teuthology.orchestra.run.smithi171.stdout:(134/142): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-06-11T15:57:13.568 INFO:teuthology.orchestra.run.smithi171.stdout:(135/142): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-11T15:57:13.604 INFO:teuthology.orchestra.run.smithi089.stdout:(63/142): ceph-common-19.0.0-2976.g3f51ea39.el9 2.1 MB/s | 21 MB 00:09 2024-06-11T15:57:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/149 2024-06-11T15:57:13.677 INFO:teuthology.orchestra.run.smithi171.stdout:(136/142): elfutils-debuginfod-client-0.191-4.e 339 kB/s | 37 kB 00:00 2024-06-11T15:57:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:13.746 INFO:teuthology.orchestra.run.smithi089.stdout:(64/142): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-06-11T15:57:13.811 INFO:teuthology.orchestra.run.smithi171.stdout:(137/142): librados2-19.0.0-2976.g3f51ea39.el9. 10 MB/s | 3.4 MB 00:00 2024-06-11T15:57:13.829 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:13.836 INFO:teuthology.orchestra.run.smithi171.stdout:(138/142): elfutils-libelf-0.191-4.el9.x86_64.r 1.3 MB/s | 207 kB 00:00 2024-06-11T15:57:13.859 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:13.880 INFO:teuthology.orchestra.run.smithi089.stdout:(65/142): openblas-openmp-0.3.21-2.el9.x86_64.r 3.5 MB/s | 4.7 MB 00:01 2024-06-11T15:57:13.951 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:14.001 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:57:14.005 INFO:teuthology.orchestra.run.smithi089.stdout:(66/142): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-06-11T15:57:14.078 INFO:teuthology.orchestra.run.smithi171.stdout:(139/142): elfutils-libs-0.191-4.el9.x86_64.rpm 973 kB/s | 260 kB 00:00 2024-06-11T15:57:14.092 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/149 2024-06-11T15:57:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:14.123 INFO:teuthology.orchestra.run.smithi089.stdout:(67/142): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-06-11T15:57:14.147 INFO:teuthology.orchestra.run.smithi089.stdout:(68/142): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-06-11T15:57:14.153 INFO:teuthology.orchestra.run.smithi171.stdout:(140/142): openssl-3.2.1-1.el9.x86_64.rpm 4.3 MB/s | 1.3 MB 00:00 2024-06-11T15:57:14.181 INFO:teuthology.orchestra.run.smithi089.stdout:(69/142): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-06-11T15:57:14.206 INFO:teuthology.orchestra.run.smithi089.stdout:(70/142): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-06-11T15:57:14.207 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:14.229 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:14.262 INFO:teuthology.orchestra.run.smithi171.stdout:(141/142): librbd1-19.0.0-2976.g3f51ea39.el9.x8 4.2 MB/s | 3.1 MB 00:00 2024-06-11T15:57:14.265 INFO:teuthology.orchestra.run.smithi089.stdout:(71/142): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-06-11T15:57:14.292 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:14.298 INFO:teuthology.orchestra.run.smithi089.stdout:(72/142): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-06-11T15:57:14.322 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:14.343 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:14.415 INFO:teuthology.orchestra.run.smithi089.stdout:(73/142): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-06-11T15:57:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:14.532 INFO:teuthology.orchestra.run.smithi089.stdout:(74/142): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-06-11T15:57:14.599 INFO:teuthology.orchestra.run.smithi089.stdout:(75/142): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-06-11T15:57:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/149 2024-06-11T15:57:14.675 INFO:teuthology.orchestra.run.smithi089.stdout:(76/142): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-06-11T15:57:14.743 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/149 2024-06-11T15:57:14.788 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/149 2024-06-11T15:57:14.791 INFO:teuthology.orchestra.run.smithi089.stdout:(77/142): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-06-11T15:57:14.804 INFO:teuthology.orchestra.run.smithi171.stdout:(142/142): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-06-11T15:57:14.811 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:57:14.811 INFO:teuthology.orchestra.run.smithi171.stdout:Total 7.5 MB/s | 212 MB 00:28 2024-06-11T15:57:14.823 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/149 2024-06-11T15:57:14.858 INFO:teuthology.orchestra.run.smithi089.stdout:(78/142): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-06-11T15:57:14.898 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/149 2024-06-11T15:57:14.939 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/149 2024-06-11T15:57:14.950 INFO:teuthology.orchestra.run.smithi089.stdout:(79/142): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-06-11T15:57:14.982 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/149 2024-06-11T15:57:15.017 INFO:teuthology.orchestra.run.smithi089.stdout:(80/142): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-06-11T15:57:15.024 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/149 2024-06-11T15:57:15.043 INFO:teuthology.orchestra.run.smithi089.stdout:(81/142): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-06-11T15:57:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/149 2024-06-11T15:57:15.085 INFO:teuthology.orchestra.run.smithi089.stdout:(82/142): python3-requests-oauthlib-1.3.0-12.el 801 kB/s | 54 kB 00:00 2024-06-11T15:57:15.107 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-06-11T15:57:15.107 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-06-11T15:57:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/149 2024-06-11T15:57:15.152 INFO:teuthology.orchestra.run.smithi089.stdout:(83/142): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-06-11T15:57:15.173 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/149 2024-06-11T15:57:15.208 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/149 2024-06-11T15:57:15.248 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/149 2024-06-11T15:57:15.277 INFO:teuthology.orchestra.run.smithi089.stdout:(84/142): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-06-11T15:57:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/149 2024-06-11T15:57:15.344 INFO:teuthology.orchestra.run.smithi089.stdout:(85/142): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-06-11T15:57:15.384 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 30/149 2024-06-11T15:57:15.411 INFO:teuthology.orchestra.run.smithi089.stdout:(86/142): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-06-11T15:57:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 31/149 2024-06-11T15:57:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 32/149 2024-06-11T15:57:15.503 INFO:teuthology.orchestra.run.smithi089.stdout:(87/142): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-06-11T15:57:15.526 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/149 2024-06-11T15:57:15.570 INFO:teuthology.orchestra.run.smithi089.stdout:(88/142): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-06-11T15:57:15.581 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/149 2024-06-11T15:57:15.604 INFO:teuthology.orchestra.run.smithi089.stdout:(89/142): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 934 kB/s | 94 kB 00:00 2024-06-11T15:57:15.629 INFO:teuthology.orchestra.run.smithi089.stdout:(90/142): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-11T15:57:15.630 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:15.655 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/149 2024-06-11T15:57:15.663 INFO:teuthology.orchestra.run.smithi089.stdout:(91/142): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-06-11T15:57:15.663 INFO:teuthology.orchestra.run.smithi089.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-11T15:57:15.763 INFO:teuthology.orchestra.run.smithi089.stdout:(92/142): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-06-11T15:57:15.791 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-06-11T15:57:15.791 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/149 2024-06-11T15:57:15.796 INFO:teuthology.orchestra.run.smithi089.stdout:(93/142): abseil-cpp-20211102.0-3.el9.x86_64.rp 17 MB/s | 548 kB 00:00 2024-06-11T15:57:15.830 INFO:teuthology.orchestra.run.smithi089.stdout:(94/142): gperftools-libs-2.9.1-2.el9.x86_64.rp 9.1 MB/s | 309 kB 00:00 2024-06-11T15:57:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/149 2024-06-11T15:57:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:(95/142): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-06-11T15:57:15.939 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-06-11T15:57:15.939 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-06-11T15:57:15.956 INFO:teuthology.orchestra.run.smithi089.stdout:(96/142): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-06-11T15:57:15.981 INFO:teuthology.orchestra.run.smithi089.stdout:(97/142): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-11T15:57:16.006 INFO:teuthology.orchestra.run.smithi089.stdout:(98/142): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-11T15:57:16.040 INFO:teuthology.orchestra.run.smithi089.stdout:(99/142): protobuf-compiler-3.14.0-13.el9.x86_6 2.2 MB/s | 863 kB 00:00 2024-06-11T15:57:16.065 INFO:teuthology.orchestra.run.smithi089.stdout:(100/142): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-06-11T15:57:16.141 INFO:teuthology.orchestra.run.smithi089.stdout:(101/142): parquet-libs-9.0.0-11.el9.x86_64.rpm 17 MB/s | 839 kB 00:00 2024-06-11T15:57:16.166 INFO:teuthology.orchestra.run.smithi089.stdout:(102/142): luarocks-3.9.2-5.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-06-11T15:57:16.199 INFO:teuthology.orchestra.run.smithi089.stdout:(103/142): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-06-11T15:57:16.225 INFO:teuthology.orchestra.run.smithi089.stdout:(104/142): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-06-11T15:57:16.250 INFO:teuthology.orchestra.run.smithi089.stdout:(105/142): python3-certifi-2021.10.8-2.el9.noar 600 kB/s | 15 kB 00:00 2024-06-11T15:57:16.275 INFO:teuthology.orchestra.run.smithi089.stdout:(106/142): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-06-11T15:57:16.301 INFO:teuthology.orchestra.run.smithi089.stdout:(107/142): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-11T15:57:16.326 INFO:teuthology.orchestra.run.smithi089.stdout:(108/142): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-06-11T15:57:16.351 INFO:teuthology.orchestra.run.smithi089.stdout:(109/142): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-11T15:57:16.376 INFO:teuthology.orchestra.run.smithi089.stdout:(110/142): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-06-11T15:57:16.380 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/149 2024-06-11T15:57:16.393 INFO:teuthology.orchestra.run.smithi089.stdout:(111/142): python3-jaraco-8.2.1-3.el9.noarch.rp 641 kB/s | 11 kB 00:00 2024-06-11T15:57:16.410 INFO:teuthology.orchestra.run.smithi089.stdout:(112/142): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-06-11T15:57:16.444 INFO:teuthology.orchestra.run.smithi089.stdout:(113/142): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-06-11T15:57:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:(114/142): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-06-11T15:57:16.471 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/149 2024-06-11T15:57:16.495 INFO:teuthology.orchestra.run.smithi089.stdout:(115/142): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-06-11T15:57:16.499 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/149 2024-06-11T15:57:16.538 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/149 2024-06-11T15:57:16.554 INFO:teuthology.orchestra.run.smithi089.stdout:(116/142): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-06-11T15:57:16.579 INFO:teuthology.orchestra.run.smithi089.stdout:(117/142): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-11T15:57:16.593 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 42/149 2024-06-11T15:57:16.604 INFO:teuthology.orchestra.run.smithi089.stdout:(118/142): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-11T15:57:16.630 INFO:teuthology.orchestra.run.smithi089.stdout:(119/142): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-11T15:57:16.631 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 43/149 2024-06-11T15:57:16.663 INFO:teuthology.orchestra.run.smithi089.stdout:(120/142): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-06-11T15:57:16.674 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/149 2024-06-11T15:57:16.688 INFO:teuthology.orchestra.run.smithi089.stdout:(121/142): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-06-11T15:57:16.714 INFO:teuthology.orchestra.run.smithi089.stdout:(122/142): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-11T15:57:16.739 INFO:teuthology.orchestra.run.smithi089.stdout:(123/142): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-06-11T15:57:16.764 INFO:teuthology.orchestra.run.smithi089.stdout:(124/142): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-06-11T15:57:16.790 INFO:teuthology.orchestra.run.smithi089.stdout:(125/142): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-11T15:57:16.815 INFO:teuthology.orchestra.run.smithi089.stdout:(126/142): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-11T15:57:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/149 2024-06-11T15:57:16.840 INFO:teuthology.orchestra.run.smithi089.stdout:(127/142): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-06-11T15:57:16.865 INFO:teuthology.orchestra.run.smithi089.stdout:(128/142): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-11T15:57:16.891 INFO:teuthology.orchestra.run.smithi089.stdout:(129/142): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-06-11T15:57:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/149 2024-06-11T15:57:16.916 INFO:teuthology.orchestra.run.smithi089.stdout:(130/142): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-11T15:57:16.941 INFO:teuthology.orchestra.run.smithi089.stdout:(131/142): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-06-11T15:57:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/149 2024-06-11T15:57:16.967 INFO:teuthology.orchestra.run.smithi089.stdout:(132/142): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-06-11T15:57:16.992 INFO:teuthology.orchestra.run.smithi089.stdout:(133/142): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-11T15:57:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/149 2024-06-11T15:57:17.059 INFO:teuthology.orchestra.run.smithi089.stdout:(134/142): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-06-11T15:57:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/149 2024-06-11T15:57:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/149 2024-06-11T15:57:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/149 2024-06-11T15:57:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/149 2024-06-11T15:57:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/149 2024-06-11T15:57:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/149 2024-06-11T15:57:17.418 INFO:teuthology.orchestra.run.smithi089.stdout:(135/142): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.8 MB/s | 16 MB 00:02 2024-06-11T15:57:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/149 2024-06-11T15:57:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/149 2024-06-11T15:57:17.476 INFO:teuthology.orchestra.run.smithi089.stdout:(136/142): librados2-19.0.0-2976.g3f51ea39.el9. 7.0 MB/s | 3.4 MB 00:00 2024-06-11T15:57:17.501 INFO:teuthology.orchestra.run.smithi089.stdout:(137/142): elfutils-debuginfod-client-0.191-4.e 440 kB/s | 37 kB 00:00 2024-06-11T15:57:17.552 INFO:teuthology.orchestra.run.smithi089.stdout:(138/142): librbd1-19.0.0-2976.g3f51ea39.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-06-11T15:57:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/149 2024-06-11T15:57:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 58/149 2024-06-11T15:57:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/149 2024-06-11T15:57:17.652 INFO:teuthology.orchestra.run.smithi089.stdout:(139/142): elfutils-libelf-0.191-4.el9.x86_64.r 1.2 MB/s | 207 kB 00:00 2024-06-11T15:57:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/149 2024-06-11T15:57:17.686 INFO:teuthology.orchestra.run.smithi089.stdout:(140/142): elfutils-libs-0.191-4.el9.x86_64.rpm 1.4 MB/s | 260 kB 00:00 2024-06-11T15:57:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 61/149 2024-06-11T15:57:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/149 2024-06-11T15:57:17.924 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-06-11T15:57:17.924 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-06-11T15:57:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 63/149 2024-06-11T15:57:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/149 2024-06-11T15:57:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 65/149 2024-06-11T15:57:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/149 2024-06-11T15:57:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 67/149 2024-06-11T15:57:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 68/149 2024-06-11T15:57:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 69/149 2024-06-11T15:57:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 70/149 2024-06-11T15:57:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 71/149 2024-06-11T15:57:18.378 INFO:teuthology.orchestra.run.smithi089.stdout:(141/142): openssl-3.2.1-1.el9.x86_64.rpm 1.6 MB/s | 1.3 MB 00:00 2024-06-11T15:57:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 72/149 2024-06-11T15:57:18.442 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 73/149 2024-06-11T15:57:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 74/149 2024-06-11T15:57:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/149 2024-06-11T15:57:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 76/149 2024-06-11T15:57:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 77/149 2024-06-11T15:57:18.869 INFO:teuthology.orchestra.run.smithi089.stdout:(142/142): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-06-11T15:57:18.875 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-06-11T15:57:18.875 INFO:teuthology.orchestra.run.smithi089.stdout:Total 13 MB/s | 212 MB 00:15 2024-06-11T15:57:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/149 2024-06-11T15:57:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 79/149 2024-06-11T15:57:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 80/149 2024-06-11T15:57:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 81/149 2024-06-11T15:57:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 82/149 2024-06-11T15:57:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.21-2.el9.x86_64 83/149 2024-06-11T15:57:19.836 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 84/149 2024-06-11T15:57:19.909 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-06-11T15:57:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 85/149 2024-06-11T15:57:20.053 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-06-11T15:57:20.053 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-06-11T15:57:20.591 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 86/149 2024-06-11T15:57:20.701 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 87/149 2024-06-11T15:57:20.764 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-06-11T15:57:20.846 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/149 2024-06-11T15:57:20.884 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/149 2024-06-11T15:57:20.947 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/149 2024-06-11T15:57:20.979 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/149 2024-06-11T15:57:21.005 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/149 2024-06-11T15:57:21.064 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/149 2024-06-11T15:57:21.390 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/149 2024-06-11T15:57:21.506 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:21.626 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:21.649 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:21.740 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:21.785 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:57:21.865 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/149 2024-06-11T15:57:21.893 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:21.971 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/149 2024-06-11T15:57:22.000 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:22.004 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-06-11T15:57:22.005 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-06-11T15:57:22.027 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 89/149 2024-06-11T15:57:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 90/149 2024-06-11T15:57:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 91/149 2024-06-11T15:57:22.133 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:22.322 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:22.353 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:22.433 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 92/149 2024-06-11T15:57:22.461 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/149 2024-06-11T15:57:22.481 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:22.555 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/149 2024-06-11T15:57:22.585 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/149 2024-06-11T15:57:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 94/149 2024-06-11T15:57:22.620 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/149 2024-06-11T15:57:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 95/149 2024-06-11T15:57:22.694 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/149 2024-06-11T15:57:22.728 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/149 2024-06-11T15:57:22.772 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/149 2024-06-11T15:57:22.805 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/149 2024-06-11T15:57:22.832 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/149 2024-06-11T15:57:22.902 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/149 2024-06-11T15:57:22.955 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/149 2024-06-11T15:57:22.990 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/149 2024-06-11T15:57:23.037 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/149 2024-06-11T15:57:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/149 2024-06-11T15:57:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 96/149 2024-06-11T15:57:23.147 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 30/149 2024-06-11T15:57:23.148 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:23.191 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 31/149 2024-06-11T15:57:23.211 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:23.220 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 32/149 2024-06-11T15:57:23.234 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 98/149 2024-06-11T15:57:23.288 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/149 2024-06-11T15:57:23.342 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/149 2024-06-11T15:57:23.416 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/149 2024-06-11T15:57:23.483 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-06-11T15:57:23.548 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/149 2024-06-11T15:57:23.559 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/149 2024-06-11T15:57:23.602 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/149 2024-06-11T15:57:23.606 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/149 2024-06-11T15:57:23.668 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/149 2024-06-11T15:57:23.708 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/149 2024-06-11T15:57:23.734 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/149 2024-06-11T15:57:23.784 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/149 2024-06-11T15:57:24.132 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/149 2024-06-11T15:57:24.199 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/149 2024-06-11T15:57:24.215 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/149 2024-06-11T15:57:24.244 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/149 2024-06-11T15:57:24.252 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:24.297 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/149 2024-06-11T15:57:24.338 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 42/149 2024-06-11T15:57:24.374 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:24.376 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 43/149 2024-06-11T15:57:24.412 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:24.418 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/149 2024-06-11T15:57:24.503 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:24.550 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:57:24.563 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/149 2024-06-11T15:57:24.619 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/149 2024-06-11T15:57:24.620 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/149 2024-06-11T15:57:24.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:24.675 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/149 2024-06-11T15:57:24.734 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:24.747 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/149 2024-06-11T15:57:24.756 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:24.779 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/149 2024-06-11T15:57:24.815 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/149 2024-06-11T15:57:24.819 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:24.841 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:24.862 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/149 2024-06-11T15:57:24.866 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:24.907 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/149 2024-06-11T15:57:24.949 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/149 2024-06-11T15:57:25.064 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:25.084 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/149 2024-06-11T15:57:25.099 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:25.134 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/149 2024-06-11T15:57:25.176 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/149 2024-06-11T15:57:25.208 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/149 2024-06-11T15:57:25.269 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/149 2024-06-11T15:57:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/149 2024-06-11T15:57:25.310 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 58/149 2024-06-11T15:57:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/149 2024-06-11T15:57:25.351 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/149 2024-06-11T15:57:25.383 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/149 2024-06-11T15:57:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/149 2024-06-11T15:57:25.407 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 61/149 2024-06-11T15:57:25.447 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/149 2024-06-11T15:57:25.483 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/149 2024-06-11T15:57:25.499 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/149 2024-06-11T15:57:25.520 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:25.526 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/149 2024-06-11T15:57:25.555 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:25.559 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/149 2024-06-11T15:57:25.586 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/149 2024-06-11T15:57:25.626 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 63/149 2024-06-11T15:57:25.656 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/149 2024-06-11T15:57:25.665 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/149 2024-06-11T15:57:25.761 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/149 2024-06-11T15:57:25.761 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 65/149 2024-06-11T15:57:25.762 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/149 2024-06-11T15:57:25.766 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/149 2024-06-11T15:57:25.767 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 67/149 2024-06-11T15:57:25.802 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 68/149 2024-06-11T15:57:25.808 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/149 2024-06-11T15:57:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 69/149 2024-06-11T15:57:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 70/149 2024-06-11T15:57:25.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/149 2024-06-11T15:57:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 71/149 2024-06-11T15:57:25.919 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 30/149 2024-06-11T15:57:25.988 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 31/149 2024-06-11T15:57:25.998 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 72/149 2024-06-11T15:57:26.016 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 32/149 2024-06-11T15:57:26.042 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 73/149 2024-06-11T15:57:26.073 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 74/149 2024-06-11T15:57:26.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/149 2024-06-11T15:57:26.111 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:26.120 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/149 2024-06-11T15:57:26.140 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/149 2024-06-11T15:57:26.150 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:26.213 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/149 2024-06-11T15:57:26.218 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-20.9-5.el9.noarch 76/149 2024-06-11T15:57:26.249 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:26.250 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-11T15:57:26.250 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-11T15:57:26.250 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:26.266 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 77/149 2024-06-11T15:57:26.276 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:26.345 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/149 2024-06-11T15:57:26.408 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/149 2024-06-11T15:57:26.929 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/149 2024-06-11T15:57:26.983 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/149 2024-06-11T15:57:27.013 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/149 2024-06-11T15:57:27.038 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 79/149 2024-06-11T15:57:27.041 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/149 2024-06-11T15:57:27.071 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 80/149 2024-06-11T15:57:27.074 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/149 2024-06-11T15:57:27.126 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 42/149 2024-06-11T15:57:27.165 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 43/149 2024-06-11T15:57:27.170 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 81/149 2024-06-11T15:57:27.207 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/149 2024-06-11T15:57:27.214 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 82/149 2024-06-11T15:57:27.360 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/149 2024-06-11T15:57:27.391 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.21-2.el9.x86_64 83/149 2024-06-11T15:57:27.420 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 84/149 2024-06-11T15:57:27.434 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/149 2024-06-11T15:57:27.489 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/149 2024-06-11T15:57:27.499 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 85/149 2024-06-11T15:57:27.562 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/149 2024-06-11T15:57:27.593 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/149 2024-06-11T15:57:27.630 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/149 2024-06-11T15:57:27.676 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/149 2024-06-11T15:57:27.724 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/149 2024-06-11T15:57:27.734 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-06-11T15:57:27.775 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/149 2024-06-11T15:57:27.816 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/149 2024-06-11T15:57:27.855 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/149 2024-06-11T15:57:27.910 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/149 2024-06-11T15:57:27.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/149 2024-06-11T15:57:27.958 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/149 2024-06-11T15:57:27.960 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/149 2024-06-11T15:57:27.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/149 2024-06-11T15:57:28.000 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/149 2024-06-11T15:57:28.032 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/149 2024-06-11T15:57:28.094 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/149 2024-06-11T15:57:28.135 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 58/149 2024-06-11T15:57:28.177 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/149 2024-06-11T15:57:28.194 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 86/149 2024-06-11T15:57:28.207 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/149 2024-06-11T15:57:28.232 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 61/149 2024-06-11T15:57:28.308 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 87/149 2024-06-11T15:57:28.318 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/149 2024-06-11T15:57:28.364 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/149 2024-06-11T15:57:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 63/149 2024-06-11T15:57:28.476 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/149 2024-06-11T15:57:28.509 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 65/149 2024-06-11T15:57:28.546 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/149 2024-06-11T15:57:28.576 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 67/149 2024-06-11T15:57:28.598 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:28.611 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 68/149 2024-06-11T15:57:28.627 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:28.644 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 69/149 2024-06-11T15:57:28.685 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 70/149 2024-06-11T15:57:28.720 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:28.720 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 71/149 2024-06-11T15:57:28.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:57:28.807 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 72/149 2024-06-11T15:57:28.835 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/149 2024-06-11T15:57:28.859 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 73/149 2024-06-11T15:57:28.863 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:28.890 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 74/149 2024-06-11T15:57:28.937 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/149 2024-06-11T15:57:28.976 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:29.005 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:29.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 76/149 2024-06-11T15:57:29.068 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 13/149 2024-06-11T15:57:29.090 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:29.091 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 77/149 2024-06-11T15:57:29.117 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/149 2024-06-11T15:57:29.300 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:29.332 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/149 2024-06-11T15:57:29.440 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/149 2024-06-11T15:57:29.535 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/149 2024-06-11T15:57:29.551 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/149 2024-06-11T15:57:29.573 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/149 2024-06-11T15:57:29.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/149 2024-06-11T15:57:29.625 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 89/149 2024-06-11T15:57:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 90/149 2024-06-11T15:57:29.681 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/149 2024-06-11T15:57:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 91/149 2024-06-11T15:57:29.716 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/149 2024-06-11T15:57:29.758 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/149 2024-06-11T15:57:29.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/149 2024-06-11T15:57:29.811 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/149 2024-06-11T15:57:29.819 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/149 2024-06-11T15:57:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 79/149 2024-06-11T15:57:29.888 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/149 2024-06-11T15:57:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 80/149 2024-06-11T15:57:29.941 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/149 2024-06-11T15:57:29.982 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/149 2024-06-11T15:57:29.993 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 92/149 2024-06-11T15:57:30.005 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 81/149 2024-06-11T15:57:30.024 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/149 2024-06-11T15:57:30.032 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:30.041 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 82/149 2024-06-11T15:57:30.101 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/149 2024-06-11T15:57:30.114 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:30.135 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 30/149 2024-06-11T15:57:30.145 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 94/149 2024-06-11T15:57:30.178 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 31/149 2024-06-11T15:57:30.205 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 95/149 2024-06-11T15:57:30.207 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 32/149 2024-06-11T15:57:30.220 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 83/149 2024-06-11T15:57:30.245 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 84/149 2024-06-11T15:57:30.277 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/149 2024-06-11T15:57:30.322 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/149 2024-06-11T15:57:30.325 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 85/149 2024-06-11T15:57:30.396 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/149 2024-06-11T15:57:30.527 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/149 2024-06-11T15:57:30.583 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/149 2024-06-11T15:57:30.678 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 96/149 2024-06-11T15:57:30.702 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:30.772 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:30.795 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 98/149 2024-06-11T15:57:30.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 86/149 2024-06-11T15:57:31.086 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 87/149 2024-06-11T15:57:31.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/149 2024-06-11T15:57:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/149 2024-06-11T15:57:31.224 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/149 2024-06-11T15:57:31.261 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/149 2024-06-11T15:57:31.317 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 42/149 2024-06-11T15:57:31.355 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 43/149 2024-06-11T15:57:31.398 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/149 2024-06-11T15:57:31.558 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/149 2024-06-11T15:57:31.625 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/149 2024-06-11T15:57:31.680 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/149 2024-06-11T15:57:31.778 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/149 2024-06-11T15:57:31.809 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/149 2024-06-11T15:57:31.846 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/149 2024-06-11T15:57:31.917 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/149 2024-06-11T15:57:31.963 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/149 2024-06-11T15:57:32.005 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/149 2024-06-11T15:57:32.142 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/149 2024-06-11T15:57:32.182 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/149 2024-06-11T15:57:32.223 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/149 2024-06-11T15:57:32.317 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/149 2024-06-11T15:57:32.349 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/149 2024-06-11T15:57:32.357 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 58/149 2024-06-11T15:57:32.398 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/149 2024-06-11T15:57:32.431 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/149 2024-06-11T15:57:32.440 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 89/149 2024-06-11T15:57:32.455 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 61/149 2024-06-11T15:57:32.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 90/149 2024-06-11T15:57:32.501 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 91/149 2024-06-11T15:57:32.540 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 62/149 2024-06-11T15:57:32.666 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 63/149 2024-06-11T15:57:32.704 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 64/149 2024-06-11T15:57:32.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 65/149 2024-06-11T15:57:32.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 66/149 2024-06-11T15:57:32.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 67/149 2024-06-11T15:57:32.818 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 92/149 2024-06-11T15:57:32.834 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 68/149 2024-06-11T15:57:32.864 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:32.875 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 69/149 2024-06-11T15:57:32.917 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 70/149 2024-06-11T15:57:32.952 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 71/149 2024-06-11T15:57:32.954 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:32.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 94/149 2024-06-11T15:57:32.989 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:33.026 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 95/149 2024-06-11T15:57:33.039 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 72/149 2024-06-11T15:57:33.359 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 73/149 2024-06-11T15:57:33.512 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 96/149 2024-06-11T15:57:33.534 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 74/149 2024-06-11T15:57:33.550 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:33.575 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:33.611 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:33.621 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:33.622 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 75/149 2024-06-11T15:57:33.643 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 98/149 2024-06-11T15:57:33.702 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:33.702 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-11T15:57:33.702 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-11T15:57:33.702 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 76/149 2024-06-11T15:57:33.737 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:33.790 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 77/149 2024-06-11T15:57:34.502 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/149 2024-06-11T15:57:34.545 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 79/149 2024-06-11T15:57:34.579 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 80/149 2024-06-11T15:57:34.679 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 81/149 2024-06-11T15:57:34.721 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 82/149 2024-06-11T15:57:34.900 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 83/149 2024-06-11T15:57:34.936 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 84/149 2024-06-11T15:57:35.024 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 85/149 2024-06-11T15:57:35.682 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 86/149 2024-06-11T15:57:35.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 87/149 2024-06-11T15:57:35.925 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:35.957 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:36.503 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:36.544 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:36.639 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:36.639 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-11T15:57:36.639 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-11T15:57:36.639 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:36.670 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:37.080 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 88/149 2024-06-11T15:57:37.175 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 89/149 2024-06-11T15:57:37.203 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 90/149 2024-06-11T15:57:37.236 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 91/149 2024-06-11T15:57:37.546 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 92/149 2024-06-11T15:57:37.582 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:37.656 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 93/149 2024-06-11T15:57:37.687 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 94/149 2024-06-11T15:57:37.723 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 95/149 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-06-11T15:57:37.863 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-06-11T15:57:37.864 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:38.037 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:38.053 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:38.053 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:38.053 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-11T15:57:38.053 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:38.193 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 96/149 2024-06-11T15:57:38.227 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 97/149 2024-06-11T15:57:38.320 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 98/149 2024-06-11T15:57:39.524 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:39.550 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:39.551 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:39.551 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-11T15:57:39.551 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:39.551 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:39.551 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:39.774 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:39.797 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:39.797 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:39.798 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-11T15:57:39.798 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:39.798 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:39.798 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:40.241 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:40.264 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-11T15:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:40.265 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:40.371 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.2-8.el9.noarch 106/149 2024-06-11T15:57:40.420 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 107/149 2024-06-11T15:57:40.475 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 108/149 2024-06-11T15:57:40.563 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:40.600 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:40.661 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 109/149 2024-06-11T15:57:40.709 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 110/149 2024-06-11T15:57:40.786 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/149 2024-06-11T15:57:40.876 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 112/149 2024-06-11T15:57:41.015 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 113/149 2024-06-11T15:57:41.058 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 114/149 2024-06-11T15:57:41.091 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 115/149 2024-06-11T15:57:41.118 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-15.el9.x86_64 116/149 2024-06-11T15:57:41.141 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 99/149 2024-06-11T15:57:41.178 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:41.279 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 100/149 2024-06-11T15:57:41.279 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-11T15:57:41.279 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-11T15:57:41.279 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 118/149 2024-06-11T15:57:41.685 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 119/149 2024-06-11T15:57:41.714 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:43.748 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:43.774 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:43.878 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 123/149 2024-06-11T15:57:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:44.100 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:44.100 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-11T15:57:44.100 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:44.101 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:44.143 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:44.155 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:44.252 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 126/149 2024-06-11T15:57:44.312 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 127/149 2024-06-11T15:57:45.217 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-45.el9.x86_64 128/149 2024-06-11T15:57:45.246 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:45.270 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:45.313 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:45.336 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:45.336 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:45.336 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-11T15:57:45.336 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:45.344 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-06-11T15:57:45.344 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-06-11T15:57:45.344 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-06-11T15:57:45.345 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-06-11T15:57:45.345 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-06-11T15:57:45.345 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /root 2024-06-11T15:57:45.345 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-06-11T15:57:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:45.508 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:45.524 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:45.524 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-11T15:57:45.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:45.639 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:45.662 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:47.044 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:47.070 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:47.070 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:47.070 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-11T15:57:47.071 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:47.071 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:47.071 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:47.296 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:47.319 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:47.320 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:47.320 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-11T15:57:47.320 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:47.320 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:47.320 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:47.755 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:47.778 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:47.778 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:47.779 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-11T15:57:47.779 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:47.779 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:47.779 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:47.885 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : automake-1.16.2-8.el9.noarch 106/149 2024-06-11T15:57:47.934 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ply-3.11-14.el9.noarch 107/149 2024-06-11T15:57:47.989 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 108/149 2024-06-11T15:57:48.183 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 109/149 2024-06-11T15:57:48.231 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 110/149 2024-06-11T15:57:48.308 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/149 2024-06-11T15:57:48.397 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 112/149 2024-06-11T15:57:48.402 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:48.402 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-06-11T15:57:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:48.544 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 113/149 2024-06-11T15:57:48.589 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 114/149 2024-06-11T15:57:48.590 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:48.606 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:48.606 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:48.606 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-11T15:57:48.606 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:48.622 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 115/149 2024-06-11T15:57:48.649 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.9-15.el9.x86_64 116/149 2024-06-11T15:57:49.102 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:49.131 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:49.162 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 118/149 2024-06-11T15:57:49.224 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 119/149 2024-06-11T15:57:49.254 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:50.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:50.111 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:50.111 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:50.111 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-11T15:57:50.111 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:50.111 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:50.112 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:50.217 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 132/149 2024-06-11T15:57:50.258 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 133/149 2024-06-11T15:57:50.281 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:50.300 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 134/149 2024-06-11T15:57:50.322 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:50.331 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 135/149 2024-06-11T15:57:50.335 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:50.358 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 136/149 2024-06-11T15:57:50.358 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:50.358 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:50.358 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-11T15:57:50.359 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:50.359 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:50.359 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:50.391 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 137/149 2024-06-11T15:57:50.802 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:50.825 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:50.826 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:50.826 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-11T15:57:50.826 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:50.826 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:50.826 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:50.932 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 106/149 2024-06-11T15:57:50.981 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 107/149 2024-06-11T15:57:51.036 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 108/149 2024-06-11T15:57:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 109/149 2024-06-11T15:57:51.241 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 138/149 2024-06-11T15:57:51.270 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 110/149 2024-06-11T15:57:51.289 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:51.314 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:51.345 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 139/149 2024-06-11T15:57:51.347 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/149 2024-06-11T15:57:51.388 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/149 2024-06-11T15:57:51.417 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:51.436 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 112/149 2024-06-11T15:57:51.485 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/149 2024-06-11T15:57:51.516 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/149 2024-06-11T15:57:51.541 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/149 2024-06-11T15:57:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/149 2024-06-11T15:57:51.568 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:57:51.577 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 113/149 2024-06-11T15:57:51.586 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 123/149 2024-06-11T15:57:51.616 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:51.619 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 114/149 2024-06-11T15:57:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:57:51.640 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:51.640 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:51.641 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-11T15:57:51.641 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:51.641 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:51.652 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 115/149 2024-06-11T15:57:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/149 2024-06-11T15:57:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:57:51.679 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-15.el9.x86_64 116/149 2024-06-11T15:57:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:57:51.795 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 148/149 2024-06-11T15:57:51.809 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 126/149 2024-06-11T15:57:51.860 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:57:51.861 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 127/149 2024-06-11T15:57:52.141 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:52.161 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:52.192 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 118/149 2024-06-11T15:57:52.254 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 119/149 2024-06-11T15:57:52.284 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:52.752 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libtool-2.4.6-45.el9.x86_64 128/149 2024-06-11T15:57:52.778 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 101/149 2024-06-11T15:57:52.778 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-06-11T15:57:52.778 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-06-11T15:57:52.778 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-06-11T15:57:52.779 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-06-11T15:57:52.779 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-06-11T15:57:52.779 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-06-11T15:57:52.779 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-06-11T15:57:52.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:52.786 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:52.810 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:52.854 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:52.876 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:52.876 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:52.876 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-11T15:57:52.876 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:52.952 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:52.968 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 102/149 2024-06-11T15:57:52.968 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:52.969 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-11T15:57:52.969 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:53.180 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:53.203 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:53.203 INFO:teuthology.orchestra.run.smithi129.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:53.203 INFO:teuthology.orchestra.run.smithi129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-11T15:57:53.203 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:53.203 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:53.204 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:57:53.318 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:53.352 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:54.344 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:54.422 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:54.446 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:54.449 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 103/149 2024-06-11T15:57:54.449 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:54.449 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-11T15:57:54.449 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:54.450 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-11T15:57:54.450 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:54.607 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 123/149 2024-06-11T15:57:54.629 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:54.652 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:54.652 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:54.652 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-11T15:57:54.653 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:54.653 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:54.653 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:54.681 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:54.696 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:54.704 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 104/149 2024-06-11T15:57:54.704 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:54.704 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-11T15:57:54.705 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:54.705 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-11T15:57:54.705 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:54.707 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:54.805 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 126/149 2024-06-11T15:57:54.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 127/149 2024-06-11T15:57:55.148 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 105/149 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-11T15:57:55.172 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:55.278 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 106/149 2024-06-11T15:57:55.327 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 107/149 2024-06-11T15:57:55.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 108/149 2024-06-11T15:57:55.566 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 109/149 2024-06-11T15:57:55.607 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 110/149 2024-06-11T15:57:55.684 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/149 2024-06-11T15:57:55.762 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-45.el9.x86_64 128/149 2024-06-11T15:57:55.782 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 112/149 2024-06-11T15:57:55.791 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:55.813 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:57:55.814 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:55.814 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-11T15:57:55.814 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:55.814 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:57:55.814 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:55.858 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:57:55.880 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:55.880 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-11T15:57:55.880 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:55.919 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 113/149 2024-06-11T15:57:55.957 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 114/149 2024-06-11T15:57:55.990 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 115/149 2024-06-11T15:57:56.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-15.el9.x86_64 116/149 2024-06-11T15:57:56.184 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:56.206 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:57:56.206 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:56.206 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-11T15:57:56.206 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:56.206 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:57:56.207 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:57:56.471 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:56.499 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 117/149 2024-06-11T15:57:56.531 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 118/149 2024-06-11T15:57:56.592 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 119/149 2024-06-11T15:57:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 1/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 3/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 4/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 5/149 2024-06-11T15:57:57.146 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 6/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 7/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 11/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 13/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 14/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 15/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 16/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 17/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 18/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 19/149 2024-06-11T15:57:57.147 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 20/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 21/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 22/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 23/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 24/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 25/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 26/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 27/149 2024-06-11T15:57:57.148 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 28/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 29/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 30/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 31/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 32/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 33/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 34/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 35/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 36/149 2024-06-11T15:57:57.159 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/149 2024-06-11T15:57:57.160 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/149 2024-06-11T15:57:57.161 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/149 2024-06-11T15:57:57.162 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/149 2024-06-11T15:57:57.163 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/149 2024-06-11T15:57:57.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 110/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/149 2024-06-11T15:57:57.165 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/149 2024-06-11T15:57:57.166 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 136/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 138/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 140/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 141/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 142/149 2024-06-11T15:57:57.167 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 143/149 2024-06-11T15:57:57.168 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 144/149 2024-06-11T15:57:57.168 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 145/149 2024-06-11T15:57:57.168 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 146/149 2024-06-11T15:57:57.168 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 147/149 2024-06-11T15:57:57.168 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 148/149 2024-06-11T15:57:57.649 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 120/149 2024-06-11T15:57:57.691 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 132/149 2024-06-11T15:57:57.791 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 133/149 2024-06-11T15:57:57.840 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 134/149 2024-06-11T15:57:57.872 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 135/149 2024-06-11T15:57:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 136/149 2024-06-11T15:57:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 137/149 2024-06-11T15:57:58.652 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 121/149 2024-06-11T15:57:58.682 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:58.784 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 122/149 2024-06-11T15:57:58.790 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 138/149 2024-06-11T15:57:58.894 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 139/149 2024-06-11T15:57:58.945 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/149 2024-06-11T15:57:58.945 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 123/149 2024-06-11T15:57:58.976 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 124/149 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-11T15:57:59.000 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:57:59.045 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/149 2024-06-11T15:57:59.052 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:59.064 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 125/149 2024-06-11T15:57:59.081 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/149 2024-06-11T15:57:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/149 2024-06-11T15:57:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/149 2024-06-11T15:57:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:57:59.160 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 126/149 2024-06-11T15:57:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:57:59.210 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 127/149 2024-06-11T15:57:59.250 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/149 2024-06-11T15:57:59.250 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:57:59.337 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:57:59.369 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 148/149 2024-06-11T15:57:59.433 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 149/149 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-11T15:57:59.829 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.2-8.el9.noarch 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.7.4-5.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.830 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.831 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.4-9.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.832 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-11T15:57:59.833 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-11T15:57:59.834 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-11T15:57:59.835 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-11T15:57:59.836 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-11T15:57:59.837 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-11T15:57:59.838 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-3.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-11T15:57:59.839 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-11T15:57:59.840 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-11T15:57:59.840 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:57:59.840 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-06-11T15:58:00.105 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-45.el9.x86_64 128/149 2024-06-11T15:58:00.138 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:58:00.161 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 129/149 2024-06-11T15:58:00.161 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:58:00.161 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-11T15:58:00.162 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:58:00.162 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-11T15:58:00.162 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:00.214 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:58:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 130/149 2024-06-11T15:58:00.237 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:58:00.237 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-11T15:58:00.237 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:00.263 DEBUG:teuthology.parallel:result is None 2024-06-11T15:58:00.539 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:58:00.562 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 131/149 2024-06-11T15:58:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-11T15:58:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-11T15:58:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:58:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-11T15:58:00.563 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:00.762 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 132/149 2024-06-11T15:58:00.803 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 133/149 2024-06-11T15:58:00.852 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 134/149 2024-06-11T15:58:00.885 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 135/149 2024-06-11T15:58:00.911 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 136/149 2024-06-11T15:58:00.935 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 137/149 2024-06-11T15:58:01.790 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 138/149 2024-06-11T15:58:01.897 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 139/149 2024-06-11T15:58:01.940 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/149 2024-06-11T15:58:02.037 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/149 2024-06-11T15:58:02.076 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/149 2024-06-11T15:58:02.102 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/149 2024-06-11T15:58:02.128 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/149 2024-06-11T15:58:02.128 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:58:02.221 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:58:02.254 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/149 2024-06-11T15:58:02.255 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:58:02.340 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:58:02.365 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 148/149 2024-06-11T15:58:02.430 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:58:04.915 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:58:04.915 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 1/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 3/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 4/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 5/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 6/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 7/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 11/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:58:04.916 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 13/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 14/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 15/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 16/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 17/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 18/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 19/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 20/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 21/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 22/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 23/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 24/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 25/149 2024-06-11T15:58:04.917 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 26/149 2024-06-11T15:58:04.918 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 27/149 2024-06-11T15:58:04.918 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 28/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 29/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 30/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 31/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 32/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 33/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 34/149 2024-06-11T15:58:04.928 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 35/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 36/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/149 2024-06-11T15:58:04.929 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/149 2024-06-11T15:58:04.930 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/149 2024-06-11T15:58:04.931 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/149 2024-06-11T15:58:04.932 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/149 2024-06-11T15:58:04.933 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 110/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/149 2024-06-11T15:58:04.934 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/149 2024-06-11T15:58:04.935 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 136/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 138/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 140/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 141/149 2024-06-11T15:58:04.936 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 142/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 143/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 144/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 145/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 146/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 147/149 2024-06-11T15:58:04.937 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 148/149 2024-06-11T15:58:05.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 132/149 2024-06-11T15:58:05.151 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 133/149 2024-06-11T15:58:05.191 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 134/149 2024-06-11T15:58:05.224 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 135/149 2024-06-11T15:58:05.250 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 136/149 2024-06-11T15:58:05.275 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 137/149 2024-06-11T15:58:06.113 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 138/149 2024-06-11T15:58:06.220 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 139/149 2024-06-11T15:58:06.267 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 140/149 2024-06-11T15:58:06.361 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 141/149 2024-06-11T15:58:06.398 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 142/149 2024-06-11T15:58:06.424 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/149 2024-06-11T15:58:06.450 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/149 2024-06-11T15:58:06.450 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:58:06.535 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/149 2024-06-11T15:58:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/149 2024-06-11T15:58:06.576 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:58:06.662 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/149 2024-06-11T15:58:06.686 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 148/149 2024-06-11T15:58:06.751 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 149/149 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-11T15:58:07.572 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: automake-1.16.2-8.el9.noarch 2024-06-11T15:58:07.573 INFO:teuthology.orchestra.run.smithi129.stdout: bison-3.7.4-5.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.574 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.575 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: flex-2.6.4-9.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-11T15:58:07.576 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-11T15:58:07.577 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-11T15:58:07.578 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: lua-5.4.4-4.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-11T15:58:07.579 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-11T15:58:07.580 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-11T15:58:07.581 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-11T15:58:07.582 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-11T15:58:07.583 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ply-3.11-14.el9.noarch 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-11T15:58:07.584 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-11T15:58:07.585 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-11T15:58:07.586 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: re2-1:20211101-3.el9.x86_64 2024-06-11T15:58:07.587 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:07.588 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-06-11T15:58:07.830 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:58:07.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 1/149 2024-06-11T15:58:07.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 3/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 4/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 5/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 6/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 7/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 11/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 13/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 14/149 2024-06-11T15:58:07.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 15/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 16/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 17/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 18/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 19/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 20/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 21/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 22/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 23/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 24/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 25/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 26/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 27/149 2024-06-11T15:58:07.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 28/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 29/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 30/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 31/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 32/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 33/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 34/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 35/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 36/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/149 2024-06-11T15:58:07.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/149 2024-06-11T15:58:07.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/149 2024-06-11T15:58:07.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/149 2024-06-11T15:58:07.836 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/149 2024-06-11T15:58:07.837 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/149 2024-06-11T15:58:07.838 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 110/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/149 2024-06-11T15:58:07.839 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/149 2024-06-11T15:58:07.840 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 136/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 138/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 140/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 141/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 142/149 2024-06-11T15:58:07.841 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 143/149 2024-06-11T15:58:07.842 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 144/149 2024-06-11T15:58:07.842 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 145/149 2024-06-11T15:58:07.842 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 146/149 2024-06-11T15:58:07.842 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 147/149 2024-06-11T15:58:07.842 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 148/149 2024-06-11T15:58:08.033 DEBUG:teuthology.parallel:result is None 2024-06-11T15:58:10.338 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 149/149 2024-06-11T15:58:10.338 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:10.338 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-06-11T15:58:10.338 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-11T15:58:10.338 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.339 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.340 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-11T15:58:10.341 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-11T15:58:10.342 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-11T15:58:10.343 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.344 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-11T15:58:10.345 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:10.346 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.347 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-11T15:58:10.348 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-11T15:58:10.349 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-11T15:58:10.350 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-11T15:58:10.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:10.350 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-06-11T15:58:10.783 DEBUG:teuthology.parallel:result is None 2024-06-11T15:58:12.160 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 149/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 1/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 3/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 4/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2976.g3f51e 5/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 6/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 7/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 8/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 9/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 10/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 11/149 2024-06-11T15:58:12.161 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 12/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_ 13/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 14/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 15/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_6 16/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86 17/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 18/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el 19/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9. 20/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_6 21/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 22/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 23/149 2024-06-11T15:58:12.162 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 24/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 25/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 26/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 27/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39. 28/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noa 29/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.n 30/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f5 31/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el 32/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 33/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.e 34/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 35/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 36/149 2024-06-11T15:58:12.163 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/149 2024-06-11T15:58:12.164 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/149 2024-06-11T15:58:12.165 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/149 2024-06-11T15:58:12.166 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/149 2024-06-11T15:58:12.167 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/149 2024-06-11T15:58:12.168 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 110/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/149 2024-06-11T15:58:12.169 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/149 2024-06-11T15:58:12.170 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 136/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 138/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 140/149 2024-06-11T15:58:12.171 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 141/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 142/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 143/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 144/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 145/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 146/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 147/149 2024-06-11T15:58:12.172 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 148/149 2024-06-11T15:58:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 149/149 2024-06-11T15:58:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:14.725 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-06-11T15:58:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-11T15:58:14.725 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.727 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.0.0-2976.g3f51ea39.el9.noarch 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-11T15:58:14.728 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-11T15:58:14.729 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-11T15:58:14.730 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.731 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-11T15:58:14.732 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-11T15:58:14.733 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.734 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-11T15:58:14.735 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.0.0-2976.g3f51ea39.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-3.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-11T15:58:14.736 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-11T15:58:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-11T15:58:14.737 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:14.737 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-06-11T15:58:15.189 DEBUG:teuthology.parallel:result is None 2024-06-11T15:58:15.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:58:15.415 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-11T15:58:15.438 INFO:teuthology.orchestra.run.smithi089.stdout:19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.439 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.439 INFO:teuthology.task.install:The correct ceph version 19.0.0-2976.g3f51ea39 is installed. 2024-06-11T15:58:15.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:58:15.587 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-11T15:58:15.613 INFO:teuthology.orchestra.run.smithi129.stdout:19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.614 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.614 INFO:teuthology.task.install:The correct ceph version 19.0.0-2976.g3f51ea39 is installed. 2024-06-11T15:58:15.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:58:15.755 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-11T15:58:15.781 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.781 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.781 INFO:teuthology.task.install:The correct ceph version 19.0.0-2976.g3f51ea39 is installed. 2024-06-11T15:58:15.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:58:15.922 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-11T15:58:15.949 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.950 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2976.g3f51ea39.el9 2024-06-11T15:58:15.950 INFO:teuthology.task.install:The correct ceph version 19.0.0-2976.g3f51ea39 is installed. 2024-06-11T15:58:15.953 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-11T15:58:15.953 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:15.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T15:58:15.984 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:15.984 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T15:58:16.016 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:16.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T15:58:16.048 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:16.048 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-11T15:58:16.081 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-11T15:58:16.081 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:16.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T15:58:16.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T15:58:16.176 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:16.176 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T15:58:16.205 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T15:58:16.273 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:16.273 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T15:58:16.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T15:58:16.371 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:16.371 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-06-11T15:58:16.402 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-11T15:58:16.470 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-11T15:58:16.471 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:16.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T15:58:16.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T15:58:16.568 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:16.568 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T15:58:16.598 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T15:58:16.667 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:16.667 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T15:58:16.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T15:58:16.759 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:16.760 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-11T15:58:16.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-11T15:58:16.857 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-11T15:58:16.858 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:16.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T15:58:16.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T15:58:16.955 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:16.956 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T15:58:16.985 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T15:58:17.053 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:17.053 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T15:58:17.078 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T15:58:17.142 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:17.142 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-06-11T15:58:17.172 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-11T15:58:17.240 INFO:teuthology.run_tasks:Running task ceph... 2024-06-11T15:58:17.317 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-11T15:58:17.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-06-11T15:58:17.320 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-06-11T15:58:17.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-06-11T15:58:17.325 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-06-11T15:58:17.354 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-11T15:58:17.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T15:58:17.389 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T15:58:17.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T15:58:17.394 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-11T15:58:17.422 INFO:tasks.ceph:Creating extra log directories... 2024-06-11T15:58:17.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T15:58:17.458 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T15:58:17.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T15:58:17.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-11T15:58:17.499 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-11T15:58:17.499 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-11T15:58:17.500 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7749448', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8517, 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz15g7zKPzc67uI7Jq7i4s1ZExe3vuN7S9UVxp5oo59RgnsXV9EXd07ITvOzm2brlzw1aihEhgym//LBFM8M6Y=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEVr/ms81UTKCojlxqvuJaufY2ztwqq07O9mCVfnkeVVEKfrpjkTgGF3J1qRSr566fZ6QpOEJ/ygBOIFbevruM=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEepngUFznJC9hZsdobjMDK6MQWzJu6ucYasmbKMHaW/h81GnXP//mE6a0UwnoyQNAwGeRA7D8CYbwPMlC0KRKQ=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn9P3oO9UBQDmfZub+qwKRoqgCRI9UEoRCUvv2aeosFGC9AXW9sVw3kPa7zvatxhlnfVYNE0PxEei4mIMdqwH8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-10_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-11T15:58:17.500 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T15:58:17.525 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T15:58:17.527 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T15:58:17.530 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-11T15:58:17.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T15:58:17.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T15:58:17.584 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T15:58:17.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T15:58:17.613 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:17.613 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-06-11T15:58:17.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-11T15:58:17.665 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-06-11T15:58:17.721 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-11T15:58:17.721 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:17.721 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 675 Links: 1 2024-06-11T15:58:17.721 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:17.722 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:17.722 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-06-11 15:57:59.793672930 +0000 2024-06-11T15:58:17.722 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-06-11 15:55:22.979515543 +0000 2024-06-11T15:58:17.722 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-06-11 15:55:22.979515543 +0000 2024-06-11T15:58:17.722 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-06-11 15:55:22.979515543 +0000 2024-06-11T15:58:17.722 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-11T15:58:17.784 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-06-11T15:58:17.784 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-06-11T15:58:17.785 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000207615 s, 2.5 MB/s 2024-06-11T15:58:17.786 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-11T15:58:17.843 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-06-11T15:58:17.899 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-11T15:58:17.899 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:17.899 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 692 Links: 1 2024-06-11T15:58:17.899 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:17.899 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:17.900 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-06-11 15:57:59.793672930 +0000 2024-06-11T15:58:17.900 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-06-11 15:55:23.310508810 +0000 2024-06-11T15:58:17.900 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-06-11 15:55:23.310508810 +0000 2024-06-11T15:58:17.900 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-06-11 15:55:23.310508810 +0000 2024-06-11T15:58:17.900 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-11T15:58:17.962 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-06-11T15:58:17.962 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-06-11T15:58:17.962 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000197628 s, 2.6 MB/s 2024-06-11T15:58:17.964 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-11T15:58:18.020 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 711 Links: 1 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-06-11 15:57:59.794672910 +0000 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-06-11 15:55:23.634502219 +0000 2024-06-11T15:58:18.075 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-06-11 15:55:23.634502219 +0000 2024-06-11T15:58:18.076 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-06-11 15:55:23.634502219 +0000 2024-06-11T15:58:18.076 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-11T15:58:18.138 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-06-11T15:58:18.138 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-06-11T15:58:18.138 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000239564 s, 2.1 MB/s 2024-06-11T15:58:18.139 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-11T15:58:18.196 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-06-11 15:57:59.794672910 +0000 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-06-11 15:55:23.972495344 +0000 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-06-11 15:55:23.972495344 +0000 2024-06-11T15:58:18.251 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-06-11 15:55:23.972495344 +0000 2024-06-11T15:58:18.251 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-11T15:58:18.314 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-06-11T15:58:18.314 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-06-11T15:58:18.314 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000193847 s, 2.6 MB/s 2024-06-11T15:58:18.315 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-11T15:58:18.371 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:18.371 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:18.371 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-06-11T15:58:18.388 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-11T15:58:18.389 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-06-11T15:58:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-11T15:58:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.446 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-06-11T15:58:18.446 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.446 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.446 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-06-11 15:57:52.195110888 +0000 2024-06-11T15:58:18.447 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-06-11 15:55:25.010153413 +0000 2024-06-11T15:58:18.447 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-06-11 15:55:25.010153413 +0000 2024-06-11T15:58:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-06-11 15:55:25.010153413 +0000 2024-06-11T15:58:18.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-11T15:58:18.511 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-06-11T15:58:18.511 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-06-11T15:58:18.511 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000267239 s, 1.9 MB/s 2024-06-11T15:58:18.512 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-11T15:58:18.570 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-06-11T15:58:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-06-11 15:57:52.195110888 +0000 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-06-11 15:55:25.356145305 +0000 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-06-11 15:55:25.356145305 +0000 2024-06-11T15:58:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-06-11 15:55:25.356145305 +0000 2024-06-11T15:58:18.627 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-11T15:58:18.691 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-06-11T15:58:18.691 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-06-11T15:58:18.691 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000242119 s, 2.1 MB/s 2024-06-11T15:58:18.692 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-11T15:58:18.749 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-06-11T15:58:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-11T15:58:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.805 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-06-11T15:58:18.805 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.805 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.806 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-06-11 15:57:52.195110888 +0000 2024-06-11T15:58:18.806 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-06-11 15:55:25.678137761 +0000 2024-06-11T15:58:18.806 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-06-11 15:55:25.678137761 +0000 2024-06-11T15:58:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-06-11 15:55:25.678137761 +0000 2024-06-11T15:58:18.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-11T15:58:18.869 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-06-11T15:58:18.869 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-06-11T15:58:18.869 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000206969 s, 2.5 MB/s 2024-06-11T15:58:18.870 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-11T15:58:18.926 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-06-11T15:58:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-11T15:58:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:18.981 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-11T15:58:18.981 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:18.982 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:18.982 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-06-11 15:57:52.196110866 +0000 2024-06-11T15:58:18.982 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-06-11 15:55:26.011129958 +0000 2024-06-11T15:58:18.982 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-06-11 15:55:26.011129958 +0000 2024-06-11T15:58:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-06-11 15:55:26.011129958 +0000 2024-06-11T15:58:18.982 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-11T15:58:19.045 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-06-11T15:58:19.045 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-06-11T15:58:19.046 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000224432 s, 2.3 MB/s 2024-06-11T15:58:19.047 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-11T15:58:19.103 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:19.103 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:19.103 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-06-11T15:58:19.122 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-11T15:58:19.122 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-06-11T15:58:19.180 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-11T15:58:19.180 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:19.180 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 673 Links: 1 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-06-11 15:58:02.812435993 +0000 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-06-11 15:55:31.402295802 +0000 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-06-11 15:55:31.402295802 +0000 2024-06-11T15:58:19.181 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-06-11 15:55:31.402295802 +0000 2024-06-11T15:58:19.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-11T15:58:19.247 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-06-11T15:58:19.247 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-06-11T15:58:19.247 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000276944 s, 1.8 MB/s 2024-06-11T15:58:19.248 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-11T15:58:19.306 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-06-11T15:58:19.364 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-11T15:58:19.364 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:19.364 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 694 Links: 1 2024-06-11T15:58:19.364 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:19.365 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:19.365 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-06-11 15:58:02.812435993 +0000 2024-06-11T15:58:19.365 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-06-11 15:55:31.734289292 +0000 2024-06-11T15:58:19.365 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-06-11 15:55:31.734289292 +0000 2024-06-11T15:58:19.365 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-06-11 15:55:31.734289292 +0000 2024-06-11T15:58:19.365 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-11T15:58:19.430 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-06-11T15:58:19.430 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-06-11T15:58:19.430 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000225491 s, 2.3 MB/s 2024-06-11T15:58:19.431 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-11T15:58:19.488 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 714 Links: 1 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-06-11 15:58:02.812435993 +0000 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-06-11 15:55:32.054283017 +0000 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-06-11 15:55:32.054283017 +0000 2024-06-11T15:58:19.546 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-06-11 15:55:32.054283017 +0000 2024-06-11T15:58:19.547 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-11T15:58:19.611 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-06-11T15:58:19.611 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-06-11T15:58:19.612 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000220977 s, 2.3 MB/s 2024-06-11T15:58:19.613 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-11T15:58:19.670 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-06-11 15:58:02.813435974 +0000 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-06-11 15:55:32.372276782 +0000 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-06-11 15:55:32.372276782 +0000 2024-06-11T15:58:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-06-11 15:55:32.372276782 +0000 2024-06-11T15:58:19.727 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-11T15:58:19.792 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-06-11T15:58:19.792 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-06-11T15:58:19.792 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000196158 s, 2.6 MB/s 2024-06-11T15:58:19.794 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-11T15:58:19.851 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:19.852 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-06-11T15:58:19.852 INFO:tasks.ceph:Generating config... 2024-06-11T15:58:19.853 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-11T15:58:19.853 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-11T15:58:19.853 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-11T15:58:19.853 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-11T15:58:19.853 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-11T15:58:19.853 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-11T15:58:19.853 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-06-11T15:58:19.853 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-06-11T15:58:19.854 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-11T15:58:19.855 INFO:tasks.ceph:Setting up mon.a... 2024-06-11T15:58:19.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-11T15:58:19.910 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2024-06-11T15:58:19.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-11T15:58:19.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T15:58:19.984 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89'), ('mon.b', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]'), ('mon.c', '[v2:172.21.15.89:3302,v1:172.21.15.89:6791]')] 2024-06-11T15:58:19.984 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-06-11T15:58:19.985 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:19.985 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-11T15:58:20.040 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --addv b '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --addv c '[v2:172.21.15.89:3302,v1:172.21.15.89:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.126 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.126 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.126 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = quincy 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2024-06-11T15:58:20.128149+0000 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-06-11T15:58:20.128149+0000 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 17 (quincy) 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:1: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.b 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:2: [v2:172.21.15.89:3302/0,v1:172.21.15.89:6791/0] mon.c 2024-06-11T15:58:20.127 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-11T15:58:20.128 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-11T15:58:20.143 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 48aab8a4-b456-497c-bad9-c7e7b823c20e... 2024-06-11T15:58:20.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T15:58:20.185 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T15:58:20.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T15:58:20.190 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.225 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-06-11T15:58:20.226 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-06-11T15:58:20.227 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-06-11T15:58:20.228 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-06-11T15:58:20.229 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.230 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore compression algorithm = lz4 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore compression mode = aggressive 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2024-06-11T15:58:20.231 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: osd blocked scrub grace period = 3600 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: osd max markdown count = 1000 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.232 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:20.234 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-06-11T15:58:20.235 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-06-11T15:58:20.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-06-11T15:58:20.237 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-06-11T15:58:20.238 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-06-11T15:58:20.239 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.240 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression algorithm = lz4 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression mode = aggressive 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-06-11T15:58:20.241 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: osd blocked scrub grace period = 3600 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: osd max markdown count = 1000 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-06-11T15:58:20.242 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-06-11T15:58:20.243 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.244 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-06-11T15:58:20.245 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-06-11T15:58:20.246 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-06-11T15:58:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-06-11T15:58:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-06-11T15:58:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-06-11T15:58:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-06-11T15:58:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression algorithm = lz4 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression mode = aggressive 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-06-11T15:58:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: osd blocked scrub grace period = 3600 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: osd max markdown count = 1000 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-06-11T15:58:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-06-11T15:58:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-06-11T15:58:20.256 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-06-11T15:58:20.257 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.258 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.259 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]" 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-06-11T15:58:20.260 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug trim objects = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-06-11T15:58:20.261 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-06-11T15:58:20.262 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore compression algorithm = lz4 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore compression mode = aggressive 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: osd blocked scrub grace period = 3600 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: osd max markdown count = 1000 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-06-11T15:58:20.263 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-06-11T15:58:20.264 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-06-11T15:58:20.265 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-11T15:58:20.266 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-11T15:58:20.267 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-06-11T15:58:20.267 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2024-06-11T15:58:20.267 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2024-06-11T15:58:20.267 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-06-11T15:58:20.269 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-11T15:58:20.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-11T15:58:20.362 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-11T15:58:20.362 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:20.362 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-11T15:58:20.378 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:20.378 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-11T15:58:20.433 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-06-11T15:58:20.433 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:20.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T15:58:20.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T15:58:20.507 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:20.507 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.562 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-06-11T15:58:20.562 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:20.562 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T15:58:20.563 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T15:58:20.603 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:20.603 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.661 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T15:58:20.661 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:20.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T15:58:20.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T15:58:20.699 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:20.699 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.755 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T15:58:20.755 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:20.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-11T15:58:20.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-11T15:58:20.793 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:20.793 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:20.850 INFO:tasks.ceph:Setting up mon nodes... 2024-06-11T15:58:20.851 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-11T15:58:20.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-11T15:58:20.901 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-11T15:58:20.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-11T15:58:20.953 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-11T15:58:20.956 INFO:tasks.ceph:Setting up mds nodes... 2024-06-11T15:58:20.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-11T15:58:21.006 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-11T15:58:21.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-11T15:58:21.033 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-11T15:58:21.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-11T15:58:21.114 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-11T15:58:21.126 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-11T15:58:21.126 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-06-11T15:58:21.126 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-11T15:58:21.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:21.156 INFO:tasks.ceph:role: osd.0 2024-06-11T15:58:21.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-06-11T15:58:21.156 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T15:58:21.232 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T15:58:21.752 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-06-11T15:58:21.754 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-06-11T15:58:21.754 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-11T15:58:21.906 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-11T15:58:21.942 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:22.042 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.043+0000 7f6774a86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-11T15:58:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.048+0000 7f6774a86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-11T15:58:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.048+0000 7f6774a86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T15:58:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.048+0000 7f6774a86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T15:58:22.048 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.048+0000 7f6774a86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-11T15:58:22.052 INFO:teuthology.orchestra.run.smithi129.stderr:2024-06-11T15:58:22.053+0000 7f6774a86640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-11T15:58:24.917 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-11T15:58:24.945 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-11T15:58:24.975 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:24.976 INFO:tasks.ceph:role: osd.1 2024-06-11T15:58:24.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T15:58:24.976 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-11T15:58:25.052 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T15:58:25.053 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T15:58:25.574 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-06-11T15:58:25.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-06-11T15:58:25.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-06-11T15:58:25.727 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-11T15:58:25.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:25.870 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.870+0000 7fce77357640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-11T15:58:25.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.874+0000 7fce77357640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-11T15:58:25.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.874+0000 7fce77357640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T15:58:25.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.875+0000 7fce77357640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T15:58:25.874 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.875+0000 7fce77357640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-11T15:58:25.878 INFO:teuthology.orchestra.run.smithi163.stderr:2024-06-11T15:58:25.879+0000 7fce77357640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-11T15:58:28.726 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-11T15:58:28.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-11T15:58:28.785 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-06-11T15:58:28.785 INFO:tasks.ceph:role: osd.2 2024-06-11T15:58:28.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T15:58:28.785 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-11T15:58:28.861 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-11T15:58:28.862 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-11T15:58:29.381 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-06-11T15:58:29.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-06-11T15:58:29.384 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-06-11T15:58:29.540 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-11T15:58:29.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:29.716 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.716+0000 7fa1a32af640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-11T15:58:29.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.716+0000 7fa1a32af640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-11T15:58:29.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.716+0000 7fa1a32af640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T15:58:29.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.716+0000 7fa1a32af640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T15:58:29.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.716+0000 7fa1a32af640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-11T15:58:29.718 INFO:teuthology.orchestra.run.smithi171.stderr:2024-06-11T15:58:29.718+0000 7fa1a32af640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-11T15:58:32.579 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-11T15:58:32.610 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-11T15:58:32.610 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:32.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-11T15:58:32.640 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:32.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-11T15:58:32.708 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:32.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-11T15:58:32.776 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:32.777 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-11T15:58:32.807 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:32.807 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-11T15:58:32.837 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:32.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-11T15:58:32.867 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T15:58:32.867 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-11T15:58:32.885 INFO:tasks.ceph:Adding keys to all mons... 2024-06-11T15:58:32.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-11T15:58:32.952 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAcdGhmnwLVNRAA31134CbGMXKaZVJdfyUyVQ== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAcdGhmS1PzOBAAbXlhQkZ3qWHbb4/xQY/86Q== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAddGhmuw17ABAAroeRJc1tntzTGxrR2JEpew== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAedGhmlB2fAhAA/zPvzXGKD9bNkWRrzjwhVQ== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAhdGhmLdbyMxAAQETaNu1Wqz23NRJB7WCytQ== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAldGhm4T/OKhAA2BGKDyzI3CNm/WZ5qdF5/g== 2024-06-11T15:58:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-06-11T15:58:32.954 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAddGhmIk/lBhAA1d7YXVSO9rupTwj1MAREaw== 2024-06-11T15:58:32.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T15:58:33.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-11T15:58:33.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-11T15:58:33.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T15:58:33.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T15:58:33.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-11T15:58:33.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-11T15:58:33.362 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-11T15:58:33.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-11T15:58:33.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T15:58:33.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-11T15:58:33.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-11T15:58:33.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T15:58:33.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-11T15:58:33.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-11T15:58:33.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-11T15:58:33.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-11T15:58:33.879 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-11T15:58:33.934 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-11T15:58:33.934 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-11T15:58:33.935 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-11T15:58:33.977 INFO:tasks.ceph.mon.a:Started 2024-06-11T15:58:33.977 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-11T15:58:33.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-11T15:58:33.979 INFO:tasks.ceph.mon.b:Started 2024-06-11T15:58:33.979 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-11T15:58:33.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-11T15:58:33.981 INFO:tasks.ceph.mon.c:Started 2024-06-11T15:58:33.981 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-11T15:58:33.982 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-11T15:58:33.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-11T15:58:33.984 INFO:tasks.ceph.mgr.x:Started 2024-06-11T15:58:33.984 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-11T15:58:33.985 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-11T15:58:33.986 INFO:tasks.ceph.mgr.y:Started 2024-06-11T15:58:33.987 INFO:tasks.ceph:Setting crush tunables to default 2024-06-11T15:58:33.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2024-06-11T15:58:39.441 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-06-11T15:58:39.453 INFO:tasks.ceph:check_enable_crimson: False 2024-06-11T15:58:39.454 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-11T15:58:39.454 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-06-11T15:58:39.454 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-11T15:58:39.472 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:39.473+0000 7f9533e1b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-11T15:58:39.486 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-06-11T15:58:39.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-11T15:58:39.516 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-06-11T15:58:39.516 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-11T15:58:39.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ef58ea1e-862f-4fd9-b48e-87a3ca753c8c 0 2024-06-11T15:58:39.624 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:39.625+0000 7f9533e1b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-11T15:58:39.676 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:39.677+0000 7f9533e1b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-11T15:58:39.775 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-06-11T15:58:39.786 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 28556a85-d5a7-40a9-89e8-3a45e8eaaa35 1 2024-06-11T15:58:39.931 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:39.931+0000 7f9533e1b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-11T15:58:39.968 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-06-11T15:58:39.976 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:39.977+0000 7f9533e1b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-11T15:58:39.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 95d745de-187c-44a3-a4b1-a203f06a1cc8 2 2024-06-11T15:58:40.158 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-06-11T15:58:40.168 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:40.169+0000 7fa96421b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-11T15:58:40.171 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-11T15:58:40.171 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-11T15:58:40.173 INFO:tasks.ceph.osd.0:Started 2024-06-11T15:58:40.174 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-11T15:58:40.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-11T15:58:40.176 INFO:tasks.ceph.osd.1:Started 2024-06-11T15:58:40.176 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-11T15:58:40.176 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-11T15:58:40.179 INFO:tasks.ceph.osd.2:Started 2024-06-11T15:58:40.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:40.291 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:40.291+0000 7fa96421b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-11T15:58:40.344 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:40.345+0000 7fa96421b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-11T15:58:40.358 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:40.359 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:40.157171+0000","last_up_change":"0.000000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:40.370 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-11T15:58:40.370 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-11T15:58:40.557 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:40.558+0000 7fa96421b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-11T15:58:40.602 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:40.602+0000 7fa96421b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-11T15:58:40.673 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:40.745 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:40.746+0000 7f9533e1b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-11T15:58:40.765 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:58:40.766+0000 7fe1fb441640 -1 Falling back to public interface 2024-06-11T15:58:40.770 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:58:40.771+0000 7f88ee63c640 -1 Falling back to public interface 2024-06-11T15:58:40.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:58:40.774+0000 7fd42a0e1640 -1 Falling back to public interface 2024-06-11T15:58:40.834 INFO:teuthology.misc.health.smithi089.stdout: 2024-06-11T15:58:40.834 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":5,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:40.157171+0000","last_up_change":"0.000000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:40.838 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:40.838+0000 7f9533e1b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-11T15:58:40.844 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-06-11T15:58:40.883 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:40.883+0000 7f9533e1b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-11T15:58:41.057 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.058+0000 7f9533e1b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-11T15:58:41.104 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.104+0000 7fa96421b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-11T15:58:41.118 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.119+0000 7f9533e1b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-11T15:58:41.173 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.174+0000 7f9533e1b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-11T15:58:41.193 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.193+0000 7fa96421b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-11T15:58:41.236 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.237+0000 7fa96421b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-11T15:58:41.291 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.291+0000 7f9533e1b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-11T15:58:41.406 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.406+0000 7fa96421b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-11T15:58:41.452 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.452+0000 7fa96421b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-11T15:58:41.502 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.503+0000 7fa96421b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-11T15:58:41.618 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.619+0000 7fa96421b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-11T15:58:41.686 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.686+0000 7f9533e1b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-11T15:58:41.951 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:41.951+0000 7fa96421b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-11T15:58:41.956 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:41.957+0000 7f9533e1b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-11T15:58:42.010 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.011+0000 7f9533e1b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-11T15:58:42.132 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.132+0000 7f9533e1b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-11T15:58:42.171 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.171+0000 7fa96421b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-11T15:58:42.222 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.223+0000 7fa96421b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-11T15:58:42.341 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.341+0000 7fa96421b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-11T15:58:42.427 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.428+0000 7f9533e1b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-11T15:58:42.476 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.477+0000 7f9533e1b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-11T15:58:42.617 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.618+0000 7fa96421b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-11T15:58:42.638 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.639+0000 7f9533e1b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-11T15:58:42.663 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.663+0000 7fa96421b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-11T15:58:42.780 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.780+0000 7f9533e1b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-11T15:58:42.812 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.812+0000 7fa96421b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-11T15:58:42.831 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.832+0000 7f9533e1b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-11T15:58:42.905 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.905+0000 7f9533e1b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-11T15:58:42.949 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:42.949+0000 7fa96421b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-11T15:58:42.952 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:42.952+0000 7f9533e1b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-11T15:58:42.999 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:43.000+0000 7fa96421b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-11T15:58:43.055 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:43.055+0000 7fa96421b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-11T15:58:43.099 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:43.100+0000 7fa96421b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-11T15:58:43.445 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:43.446+0000 7f9533e1b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-11T15:58:43.504 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:43.504+0000 7fa96421b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-11T15:58:43.566 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:43.567+0000 7f9533e1b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-11T15:58:43.635 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-06-11T15:58:43.635+0000 7fa96421b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-11T15:58:44.200 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:58:44.201+0000 7fe1fb441640 -1 osd.2 0 log_to_monitors true 2024-06-11T15:58:44.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:58:44.206+0000 7fd42a0e1640 -1 osd.1 0 log_to_monitors true 2024-06-11T15:58:44.226 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:58:44.227+0000 7f88ee63c640 -1 osd.0 0 log_to_monitors true 2024-06-11T15:58:44.580 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:44.581+0000 7f94d44d4640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-11T15:58:44.581 INFO:tasks.ceph.mgr.y.smithi089.stderr:2024-06-11T15:58:44.582+0000 7f94d44d4640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-11T15:58:46.786 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:58:46.786+0000 7f88eade6640 -1 osd.0 0 waiting for initial osdmap 2024-06-11T15:58:46.799 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:58:46.800+0000 7f88e23f2640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T15:58:46.800 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:58:46.800+0000 7fe1f73d7640 -1 osd.2 0 waiting for initial osdmap 2024-06-11T15:58:46.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:58:46.802+0000 7fd426077640 -1 osd.1 0 waiting for initial osdmap 2024-06-11T15:58:46.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:58:46.811+0000 7fd41de97640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T15:58:46.813 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:58:46.814+0000 7fe1ef1f7640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T15:58:47.146 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:47.434 INFO:teuthology.misc.health.smithi089.stdout: 2024-06-11T15:58:47.435 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":7,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:46.088357+0000","last_up_change":"0.000000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:47.446 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-06-11T15:58:53.749 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:54.031 INFO:teuthology.misc.health.smithi089.stdout: 2024-06-11T15:58:54.031 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":13,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:53.137800+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:54.043 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-06-11T15:58:54.043 INFO:tasks.ceph:Creating RBD pool 2024-06-11T15:58:54.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2024-06-11T15:58:55.153 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2024-06-11T15:58:55.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-06-11T15:58:56.159 INFO:teuthology.orchestra.run.smithi089.stderr:enabled application 'rbd' on pool 'rbd' 2024-06-11T15:58:56.175 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-11T15:58:56.175 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-11T15:58:56.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-11T15:58:56.178 INFO:tasks.ceph.mds.a:Started 2024-06-11T15:58:56.178 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-11T15:58:56.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T15:58:56.254 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2024-06-11T15:58:56.501 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:56.501 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-11T15:58:56.501 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-06-11T15:58:56.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-11T15:58:56.797 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout:[ 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 1, 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": ".mgr" 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "poolnum": 2, 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: "poolname": "rbd" 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:58:56.798 INFO:teuthology.orchestra.run.smithi089.stdout:] 2024-06-11T15:58:56.810 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-11T15:58:56.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-11T15:58:57.155 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' created 2024-06-11T15:58:57.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-11T15:58:58.160 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' created 2024-06-11T15:58:58.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-11T15:58:59.193 INFO:teuthology.orchestra.run.smithi089.stderr:new fs with metadata pool 3 and data pool 4 2024-06-11T15:58:59.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:59.497 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:59.497 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:58.505770+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:59.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:58:59.793 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:58:59.794 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":18,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:58:58.505770+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:58:59.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-11T15:59:00.214 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-11T15:59:00.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-11T15:59:01.218 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-11T15:59:01.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T15:59:01.260 INFO:tasks.ceph.mds.a.smithi089.stderr:2024-06-11T15:59:01.260+0000 7fe717932640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-11T15:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:01.536 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T15:59:01.536 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T15:59:01.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:59:01.874 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:01.875 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:59:00.181412+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:59:01.887 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T15:59:01.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:02.174 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:02.176 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:02.185 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-11T15:59:01.577137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85744,"kb_used_data":520,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029776,"statfs":{"total":289910292480,"available":289822490624,"internally_reserved":0,"allocated":532480,"data_stored":1310339,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":87223632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417136"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164594+0000","last_change":"2024-06-11T15:58:57.164594+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164594+0000","last_undegraded":"2024-06-11T15:58:57.164594+0000","last_fullsized":"2024-06-11T15:58:57.164594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161251+0000","last_change":"2024-06-11T15:58:57.161251+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161251+0000","last_undegraded":"2024-06-11T15:58:57.161251+0000","last_fullsized":"2024-06-11T15:58:57.161251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162411+0000","last_change":"2024-06-11T15:58:57.162411+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162411+0000","last_undegraded":"2024-06-11T15:58:57.162411+0000","last_fullsized":"2024-06-11T15:58:57.162411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163913+0000","last_change":"2024-06-11T15:58:57.163913+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163913+0000","last_undegraded":"2024-06-11T15:58:57.163913+0000","last_fullsized":"2024-06-11T15:58:57.163913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163895+0000","last_change":"2024-06-11T15:58:57.163895+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163895+0000","last_undegraded":"2024-06-11T15:58:57.163895+0000","last_fullsized":"2024-06-11T15:58:57.163895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161972+0000","last_change":"2024-06-11T15:58:57.161972+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161972+0000","last_undegraded":"2024-06-11T15:58:57.161972+0000","last_fullsized":"2024-06-11T15:58:57.161972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164905+0000","last_change":"2024-06-11T15:58:57.164905+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164905+0000","last_undegraded":"2024-06-11T15:58:57.164905+0000","last_fullsized":"2024-06-11T15:58:57.164905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163725+0000","last_change":"2024-06-11T15:58:57.163725+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163725+0000","last_undegraded":"2024-06-11T15:58:57.163725+0000","last_fullsized":"2024-06-11T15:58:57.163725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160575+0000","last_change":"2024-06-11T15:58:57.160575+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160575+0000","last_undegraded":"2024-06-11T15:58:57.160575+0000","last_fullsized":"2024-06-11T15:58:57.160575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163973+0000","last_change":"2024-06-11T15:58:57.163973+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163973+0000","last_undegraded":"2024-06-11T15:58:57.163973+0000","last_fullsized":"2024-06-11T15:58:57.163973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161753+0000","last_change":"2024-06-11T15:58:57.161753+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161753+0000","last_undegraded":"2024-06-11T15:58:57.161753+0000","last_fullsized":"2024-06-11T15:58:57.161753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162492+0000","last_change":"2024-06-11T15:58:57.162492+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162492+0000","last_undegraded":"2024-06-11T15:58:57.162492+0000","last_fullsized":"2024-06-11T15:58:57.162492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":215,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.165977+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:58:57.165977+0000","last_peered":"2024-06-11T15:58:57.165977+0000","last_clean":"2024-06-11T15:58:57.165977+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:58:57.165977+0000","last_undegraded":"2024-06-11T15:58:57.165977+0000","last_fullsized":"2024-06-11T15:58:57.165977+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:58:57.166088+0000","last_peered":"2024-06-11T15:58:57.166088+0000","last_clean":"2024-06-11T15:58:57.166088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:58:57.166088+0000","last_undegraded":"2024-06-11T15:58:57.166088+0000","last_fullsized":"2024-06-11T15:58:57.166088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160420+0000","last_change":"2024-06-11T15:58:57.160420+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160420+0000","last_undegraded":"2024-06-11T15:58:57.160420+0000","last_fullsized":"2024-06-11T15:58:57.160420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166246+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:58:57.166246+0000","last_peered":"2024-06-11T15:58:57.166246+0000","last_clean":"2024-06-11T15:58:57.166246+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:58:57.166246+0000","last_undegraded":"2024-06-11T15:58:57.166246+0000","last_fullsized":"2024-06-11T15:58:57.166246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160407+0000","last_change":"2024-06-11T15:58:57.160407+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160407+0000","last_undegraded":"2024-06-11T15:58:57.160407+0000","last_fullsized":"2024-06-11T15:58:57.160407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158467+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:58:57.158467+0000","last_peered":"2024-06-11T15:58:57.158467+0000","last_clean":"2024-06-11T15:58:57.158467+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:58:57.158467+0000","last_undegraded":"2024-06-11T15:58:57.158467+0000","last_fullsized":"2024-06-11T15:58:57.158467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161795+0000","last_change":"2024-06-11T15:58:57.161795+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161795+0000","last_undegraded":"2024-06-11T15:58:57.161795+0000","last_fullsized":"2024-06-11T15:58:57.161795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166116+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:58:57.166116+0000","last_peered":"2024-06-11T15:58:57.166116+0000","last_clean":"2024-06-11T15:58:57.166116+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:58:57.166116+0000","last_undegraded":"2024-06-11T15:58:57.166116+0000","last_fullsized":"2024-06-11T15:58:57.166116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163665+0000","last_change":"2024-06-11T15:58:57.163665+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163665+0000","last_undegraded":"2024-06-11T15:58:57.163665+0000","last_fullsized":"2024-06-11T15:58:57.163665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163712+0000","last_change":"2024-06-11T15:58:57.163712+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163712+0000","last_undegraded":"2024-06-11T15:58:57.163712+0000","last_fullsized":"2024-06-11T15:58:57.163712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158482+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:58:57.158482+0000","last_peered":"2024-06-11T15:58:57.158482+0000","last_clean":"2024-06-11T15:58:57.158482+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:58:57.158482+0000","last_undegraded":"2024-06-11T15:58:57.158482+0000","last_fullsized":"2024-06-11T15:58:57.158482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160356+0000","last_change":"2024-06-11T15:58:57.160356+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160356+0000","last_undegraded":"2024-06-11T15:58:57.160356+0000","last_fullsized":"2024-06-11T15:58:57.160356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.163245+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:58:57.163245+0000","last_peered":"2024-06-11T15:58:57.163245+0000","last_clean":"2024-06-11T15:58:57.163245+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:58:57.163245+0000","last_undegraded":"2024-06-11T15:58:57.163245+0000","last_fullsized":"2024-06-11T15:58:57.163245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160573+0000","last_change":"2024-06-11T15:58:57.160573+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160573+0000","last_undegraded":"2024-06-11T15:58:57.160573+0000","last_fullsized":"2024-06-11T15:58:57.160573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158490+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:58:57.158490+0000","last_peered":"2024-06-11T15:58:57.158490+0000","last_clean":"2024-06-11T15:58:57.158490+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:58:57.158490+0000","last_undegraded":"2024-06-11T15:58:57.158490+0000","last_fullsized":"2024-06-11T15:58:57.158490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160433+0000","last_change":"2024-06-11T15:58:57.160433+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160433+0000","last_undegraded":"2024-06-11T15:58:57.160433+0000","last_fullsized":"2024-06-11T15:58:57.160433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166107+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:58:57.166107+0000","last_peered":"2024-06-11T15:58:57.166107+0000","last_clean":"2024-06-11T15:58:57.166107+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:58:57.166107+0000","last_undegraded":"2024-06-11T15:58:57.166107+0000","last_fullsized":"2024-06-11T15:58:57.166107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164776+0000","last_change":"2024-06-11T15:58:57.164776+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164776+0000","last_undegraded":"2024-06-11T15:58:57.164776+0000","last_fullsized":"2024-06-11T15:58:57.164776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161784+0000","last_change":"2024-06-11T15:58:57.161784+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161784+0000","last_undegraded":"2024-06-11T15:58:57.161784+0000","last_fullsized":"2024-06-11T15:58:57.161784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163879+0000","last_change":"2024-06-11T15:58:57.163879+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163879+0000","last_undegraded":"2024-06-11T15:58:57.163879+0000","last_fullsized":"2024-06-11T15:58:57.163879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161421+0000","last_change":"2024-06-11T15:58:57.161421+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161421+0000","last_undegraded":"2024-06-11T15:58:57.161421+0000","last_fullsized":"2024-06-11T15:58:57.161421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161333+0000","last_change":"2024-06-11T15:58:57.161333+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161333+0000","last_undegraded":"2024-06-11T15:58:57.161333+0000","last_fullsized":"2024-06-11T15:58:57.161333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161351+0000","last_change":"2024-06-11T15:58:57.161351+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161351+0000","last_undegraded":"2024-06-11T15:58:57.161351+0000","last_fullsized":"2024-06-11T15:58:57.161351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161789+0000","last_change":"2024-06-11T15:58:57.161789+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161789+0000","last_undegraded":"2024-06-11T15:58:57.161789+0000","last_fullsized":"2024-06-11T15:58:57.161789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161834+0000","last_change":"2024-06-11T15:58:57.161834+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161834+0000","last_undegraded":"2024-06-11T15:58:57.161834+0000","last_fullsized":"2024-06-11T15:58:57.161834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.165370+0000","last_change":"2024-06-11T15:58:57.165370+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.165370+0000","last_undegraded":"2024-06-11T15:58:57.165370+0000","last_fullsized":"2024-06-11T15:58:57.165370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162544+0000","last_change":"2024-06-11T15:58:57.162544+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162544+0000","last_undegraded":"2024-06-11T15:58:57.162544+0000","last_fullsized":"2024-06-11T15:58:57.162544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161368+0000","last_change":"2024-06-11T15:58:57.161368+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161368+0000","last_undegraded":"2024-06-11T15:58:57.161368+0000","last_fullsized":"2024-06-11T15:58:57.161368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162091+0000","last_change":"2024-06-11T15:58:57.162091+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162091+0000","last_undegraded":"2024-06-11T15:58:57.162091+0000","last_fullsized":"2024-06-11T15:58:57.162091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:02.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:02.528 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:02.539 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-11T15:59:01.577137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85744,"kb_used_data":520,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029776,"statfs":{"total":289910292480,"available":289822490624,"internally_reserved":0,"allocated":532480,"data_stored":1310339,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":87223632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417136"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164594+0000","last_change":"2024-06-11T15:58:57.164594+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164594+0000","last_undegraded":"2024-06-11T15:58:57.164594+0000","last_fullsized":"2024-06-11T15:58:57.164594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161251+0000","last_change":"2024-06-11T15:58:57.161251+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161251+0000","last_undegraded":"2024-06-11T15:58:57.161251+0000","last_fullsized":"2024-06-11T15:58:57.161251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162411+0000","last_change":"2024-06-11T15:58:57.162411+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162411+0000","last_undegraded":"2024-06-11T15:58:57.162411+0000","last_fullsized":"2024-06-11T15:58:57.162411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163913+0000","last_change":"2024-06-11T15:58:57.163913+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163913+0000","last_undegraded":"2024-06-11T15:58:57.163913+0000","last_fullsized":"2024-06-11T15:58:57.163913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163895+0000","last_change":"2024-06-11T15:58:57.163895+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163895+0000","last_undegraded":"2024-06-11T15:58:57.163895+0000","last_fullsized":"2024-06-11T15:58:57.163895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161972+0000","last_change":"2024-06-11T15:58:57.161972+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161972+0000","last_undegraded":"2024-06-11T15:58:57.161972+0000","last_fullsized":"2024-06-11T15:58:57.161972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164905+0000","last_change":"2024-06-11T15:58:57.164905+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164905+0000","last_undegraded":"2024-06-11T15:58:57.164905+0000","last_fullsized":"2024-06-11T15:58:57.164905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163725+0000","last_change":"2024-06-11T15:58:57.163725+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163725+0000","last_undegraded":"2024-06-11T15:58:57.163725+0000","last_fullsized":"2024-06-11T15:58:57.163725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160575+0000","last_change":"2024-06-11T15:58:57.160575+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160575+0000","last_undegraded":"2024-06-11T15:58:57.160575+0000","last_fullsized":"2024-06-11T15:58:57.160575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163973+0000","last_change":"2024-06-11T15:58:57.163973+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163973+0000","last_undegraded":"2024-06-11T15:58:57.163973+0000","last_fullsized":"2024-06-11T15:58:57.163973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161753+0000","last_change":"2024-06-11T15:58:57.161753+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161753+0000","last_undegraded":"2024-06-11T15:58:57.161753+0000","last_fullsized":"2024-06-11T15:58:57.161753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162492+0000","last_change":"2024-06-11T15:58:57.162492+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162492+0000","last_undegraded":"2024-06-11T15:58:57.162492+0000","last_fullsized":"2024-06-11T15:58:57.162492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":215,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.165977+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:58:57.165977+0000","last_peered":"2024-06-11T15:58:57.165977+0000","last_clean":"2024-06-11T15:58:57.165977+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:58:57.165977+0000","last_undegraded":"2024-06-11T15:58:57.165977+0000","last_fullsized":"2024-06-11T15:58:57.165977+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:58:57.166088+0000","last_peered":"2024-06-11T15:58:57.166088+0000","last_clean":"2024-06-11T15:58:57.166088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:58:57.166088+0000","last_undegraded":"2024-06-11T15:58:57.166088+0000","last_fullsized":"2024-06-11T15:58:57.166088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160420+0000","last_change":"2024-06-11T15:58:57.160420+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160420+0000","last_undegraded":"2024-06-11T15:58:57.160420+0000","last_fullsized":"2024-06-11T15:58:57.160420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166246+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:58:57.166246+0000","last_peered":"2024-06-11T15:58:57.166246+0000","last_clean":"2024-06-11T15:58:57.166246+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:58:57.166246+0000","last_undegraded":"2024-06-11T15:58:57.166246+0000","last_fullsized":"2024-06-11T15:58:57.166246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160407+0000","last_change":"2024-06-11T15:58:57.160407+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160407+0000","last_undegraded":"2024-06-11T15:58:57.160407+0000","last_fullsized":"2024-06-11T15:58:57.160407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158467+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:58:57.158467+0000","last_peered":"2024-06-11T15:58:57.158467+0000","last_clean":"2024-06-11T15:58:57.158467+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:58:57.158467+0000","last_undegraded":"2024-06-11T15:58:57.158467+0000","last_fullsized":"2024-06-11T15:58:57.158467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161795+0000","last_change":"2024-06-11T15:58:57.161795+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161795+0000","last_undegraded":"2024-06-11T15:58:57.161795+0000","last_fullsized":"2024-06-11T15:58:57.161795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166116+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:58:57.166116+0000","last_peered":"2024-06-11T15:58:57.166116+0000","last_clean":"2024-06-11T15:58:57.166116+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:58:57.166116+0000","last_undegraded":"2024-06-11T15:58:57.166116+0000","last_fullsized":"2024-06-11T15:58:57.166116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163665+0000","last_change":"2024-06-11T15:58:57.163665+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163665+0000","last_undegraded":"2024-06-11T15:58:57.163665+0000","last_fullsized":"2024-06-11T15:58:57.163665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163712+0000","last_change":"2024-06-11T15:58:57.163712+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163712+0000","last_undegraded":"2024-06-11T15:58:57.163712+0000","last_fullsized":"2024-06-11T15:58:57.163712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158482+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:58:57.158482+0000","last_peered":"2024-06-11T15:58:57.158482+0000","last_clean":"2024-06-11T15:58:57.158482+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:58:57.158482+0000","last_undegraded":"2024-06-11T15:58:57.158482+0000","last_fullsized":"2024-06-11T15:58:57.158482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160356+0000","last_change":"2024-06-11T15:58:57.160356+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160356+0000","last_undegraded":"2024-06-11T15:58:57.160356+0000","last_fullsized":"2024-06-11T15:58:57.160356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.163245+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:58:57.163245+0000","last_peered":"2024-06-11T15:58:57.163245+0000","last_clean":"2024-06-11T15:58:57.163245+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:58:57.163245+0000","last_undegraded":"2024-06-11T15:58:57.163245+0000","last_fullsized":"2024-06-11T15:58:57.163245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160573+0000","last_change":"2024-06-11T15:58:57.160573+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160573+0000","last_undegraded":"2024-06-11T15:58:57.160573+0000","last_fullsized":"2024-06-11T15:58:57.160573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158490+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:58:57.158490+0000","last_peered":"2024-06-11T15:58:57.158490+0000","last_clean":"2024-06-11T15:58:57.158490+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:58:57.158490+0000","last_undegraded":"2024-06-11T15:58:57.158490+0000","last_fullsized":"2024-06-11T15:58:57.158490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160433+0000","last_change":"2024-06-11T15:58:57.160433+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160433+0000","last_undegraded":"2024-06-11T15:58:57.160433+0000","last_fullsized":"2024-06-11T15:58:57.160433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166107+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:58:57.166107+0000","last_peered":"2024-06-11T15:58:57.166107+0000","last_clean":"2024-06-11T15:58:57.166107+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:58:57.166107+0000","last_undegraded":"2024-06-11T15:58:57.166107+0000","last_fullsized":"2024-06-11T15:58:57.166107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164776+0000","last_change":"2024-06-11T15:58:57.164776+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164776+0000","last_undegraded":"2024-06-11T15:58:57.164776+0000","last_fullsized":"2024-06-11T15:58:57.164776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161784+0000","last_change":"2024-06-11T15:58:57.161784+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161784+0000","last_undegraded":"2024-06-11T15:58:57.161784+0000","last_fullsized":"2024-06-11T15:58:57.161784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163879+0000","last_change":"2024-06-11T15:58:57.163879+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163879+0000","last_undegraded":"2024-06-11T15:58:57.163879+0000","last_fullsized":"2024-06-11T15:58:57.163879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161421+0000","last_change":"2024-06-11T15:58:57.161421+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161421+0000","last_undegraded":"2024-06-11T15:58:57.161421+0000","last_fullsized":"2024-06-11T15:58:57.161421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161333+0000","last_change":"2024-06-11T15:58:57.161333+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161333+0000","last_undegraded":"2024-06-11T15:58:57.161333+0000","last_fullsized":"2024-06-11T15:58:57.161333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161351+0000","last_change":"2024-06-11T15:58:57.161351+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161351+0000","last_undegraded":"2024-06-11T15:58:57.161351+0000","last_fullsized":"2024-06-11T15:58:57.161351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161789+0000","last_change":"2024-06-11T15:58:57.161789+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161789+0000","last_undegraded":"2024-06-11T15:58:57.161789+0000","last_fullsized":"2024-06-11T15:58:57.161789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161834+0000","last_change":"2024-06-11T15:58:57.161834+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161834+0000","last_undegraded":"2024-06-11T15:58:57.161834+0000","last_fullsized":"2024-06-11T15:58:57.161834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.165370+0000","last_change":"2024-06-11T15:58:57.165370+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.165370+0000","last_undegraded":"2024-06-11T15:58:57.165370+0000","last_fullsized":"2024-06-11T15:58:57.165370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162544+0000","last_change":"2024-06-11T15:58:57.162544+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162544+0000","last_undegraded":"2024-06-11T15:58:57.162544+0000","last_fullsized":"2024-06-11T15:58:57.162544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161368+0000","last_change":"2024-06-11T15:58:57.161368+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161368+0000","last_undegraded":"2024-06-11T15:58:57.161368+0000","last_fullsized":"2024-06-11T15:58:57.161368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162091+0000","last_change":"2024-06-11T15:58:57.162091+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162091+0000","last_undegraded":"2024-06-11T15:58:57.162091+0000","last_fullsized":"2024-06-11T15:58:57.162091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:02.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:02.883 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:02.884 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:02.894 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-11T15:59:01.577137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85744,"kb_used_data":520,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283029776,"statfs":{"total":289910292480,"available":289822490624,"internally_reserved":0,"allocated":532480,"data_stored":1310339,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":87223632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417136"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164594+0000","last_change":"2024-06-11T15:58:57.164594+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164594+0000","last_undegraded":"2024-06-11T15:58:57.164594+0000","last_fullsized":"2024-06-11T15:58:57.164594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161251+0000","last_change":"2024-06-11T15:58:57.161251+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161251+0000","last_undegraded":"2024-06-11T15:58:57.161251+0000","last_fullsized":"2024-06-11T15:58:57.161251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162411+0000","last_change":"2024-06-11T15:58:57.162411+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162411+0000","last_undegraded":"2024-06-11T15:58:57.162411+0000","last_fullsized":"2024-06-11T15:58:57.162411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163913+0000","last_change":"2024-06-11T15:58:57.163913+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163913+0000","last_undegraded":"2024-06-11T15:58:57.163913+0000","last_fullsized":"2024-06-11T15:58:57.163913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163895+0000","last_change":"2024-06-11T15:58:57.163895+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163895+0000","last_undegraded":"2024-06-11T15:58:57.163895+0000","last_fullsized":"2024-06-11T15:58:57.163895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161972+0000","last_change":"2024-06-11T15:58:57.161972+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161972+0000","last_undegraded":"2024-06-11T15:58:57.161972+0000","last_fullsized":"2024-06-11T15:58:57.161972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164905+0000","last_change":"2024-06-11T15:58:57.164905+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164905+0000","last_undegraded":"2024-06-11T15:58:57.164905+0000","last_fullsized":"2024-06-11T15:58:57.164905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163725+0000","last_change":"2024-06-11T15:58:57.163725+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163725+0000","last_undegraded":"2024-06-11T15:58:57.163725+0000","last_fullsized":"2024-06-11T15:58:57.163725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160575+0000","last_change":"2024-06-11T15:58:57.160575+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160575+0000","last_undegraded":"2024-06-11T15:58:57.160575+0000","last_fullsized":"2024-06-11T15:58:57.160575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163973+0000","last_change":"2024-06-11T15:58:57.163973+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163973+0000","last_undegraded":"2024-06-11T15:58:57.163973+0000","last_fullsized":"2024-06-11T15:58:57.163973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161753+0000","last_change":"2024-06-11T15:58:57.161753+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161753+0000","last_undegraded":"2024-06-11T15:58:57.161753+0000","last_fullsized":"2024-06-11T15:58:57.161753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162492+0000","last_change":"2024-06-11T15:58:57.162492+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162492+0000","last_undegraded":"2024-06-11T15:58:57.162492+0000","last_fullsized":"2024-06-11T15:58:57.162492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":215,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.165977+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:58:57.165977+0000","last_peered":"2024-06-11T15:58:57.165977+0000","last_clean":"2024-06-11T15:58:57.165977+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:58:57.165977+0000","last_undegraded":"2024-06-11T15:58:57.165977+0000","last_fullsized":"2024-06-11T15:58:57.165977+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:58:57.166088+0000","last_peered":"2024-06-11T15:58:57.166088+0000","last_clean":"2024-06-11T15:58:57.166088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:58:57.166088+0000","last_undegraded":"2024-06-11T15:58:57.166088+0000","last_fullsized":"2024-06-11T15:58:57.166088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160420+0000","last_change":"2024-06-11T15:58:57.160420+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160420+0000","last_undegraded":"2024-06-11T15:58:57.160420+0000","last_fullsized":"2024-06-11T15:58:57.160420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166246+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:58:57.166246+0000","last_peered":"2024-06-11T15:58:57.166246+0000","last_clean":"2024-06-11T15:58:57.166246+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:58:57.166246+0000","last_undegraded":"2024-06-11T15:58:57.166246+0000","last_fullsized":"2024-06-11T15:58:57.166246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160407+0000","last_change":"2024-06-11T15:58:57.160407+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160407+0000","last_undegraded":"2024-06-11T15:58:57.160407+0000","last_fullsized":"2024-06-11T15:58:57.160407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158467+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:58:57.158467+0000","last_peered":"2024-06-11T15:58:57.158467+0000","last_clean":"2024-06-11T15:58:57.158467+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:58:57.158467+0000","last_undegraded":"2024-06-11T15:58:57.158467+0000","last_fullsized":"2024-06-11T15:58:57.158467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161795+0000","last_change":"2024-06-11T15:58:57.161795+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161795+0000","last_undegraded":"2024-06-11T15:58:57.161795+0000","last_fullsized":"2024-06-11T15:58:57.161795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166116+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:58:57.166116+0000","last_peered":"2024-06-11T15:58:57.166116+0000","last_clean":"2024-06-11T15:58:57.166116+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:58:57.166116+0000","last_undegraded":"2024-06-11T15:58:57.166116+0000","last_fullsized":"2024-06-11T15:58:57.166116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163665+0000","last_change":"2024-06-11T15:58:57.163665+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163665+0000","last_undegraded":"2024-06-11T15:58:57.163665+0000","last_fullsized":"2024-06-11T15:58:57.163665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163712+0000","last_change":"2024-06-11T15:58:57.163712+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163712+0000","last_undegraded":"2024-06-11T15:58:57.163712+0000","last_fullsized":"2024-06-11T15:58:57.163712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158482+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:58:57.158482+0000","last_peered":"2024-06-11T15:58:57.158482+0000","last_clean":"2024-06-11T15:58:57.158482+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:58:57.158482+0000","last_undegraded":"2024-06-11T15:58:57.158482+0000","last_fullsized":"2024-06-11T15:58:57.158482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160356+0000","last_change":"2024-06-11T15:58:57.160356+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160356+0000","last_undegraded":"2024-06-11T15:58:57.160356+0000","last_fullsized":"2024-06-11T15:58:57.160356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.163245+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:58:57.163245+0000","last_peered":"2024-06-11T15:58:57.163245+0000","last_clean":"2024-06-11T15:58:57.163245+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:58:57.163245+0000","last_undegraded":"2024-06-11T15:58:57.163245+0000","last_fullsized":"2024-06-11T15:58:57.163245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160573+0000","last_change":"2024-06-11T15:58:57.160573+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160573+0000","last_undegraded":"2024-06-11T15:58:57.160573+0000","last_fullsized":"2024-06-11T15:58:57.160573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.158490+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:58:57.158490+0000","last_peered":"2024-06-11T15:58:57.158490+0000","last_clean":"2024-06-11T15:58:57.158490+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:58:57.158490+0000","last_undegraded":"2024-06-11T15:58:57.158490+0000","last_fullsized":"2024-06-11T15:58:57.158490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.160433+0000","last_change":"2024-06-11T15:58:57.160433+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.160433+0000","last_undegraded":"2024-06-11T15:58:57.160433+0000","last_fullsized":"2024-06-11T15:58:57.160433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-06-11T15:58:57.166107+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:58:57.166107+0000","last_peered":"2024-06-11T15:58:57.166107+0000","last_clean":"2024-06-11T15:58:57.166107+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:58:57.166107+0000","last_undegraded":"2024-06-11T15:58:57.166107+0000","last_fullsized":"2024-06-11T15:58:57.166107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.164776+0000","last_change":"2024-06-11T15:58:57.164776+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.164776+0000","last_undegraded":"2024-06-11T15:58:57.164776+0000","last_fullsized":"2024-06-11T15:58:57.164776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161784+0000","last_change":"2024-06-11T15:58:57.161784+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161784+0000","last_undegraded":"2024-06-11T15:58:57.161784+0000","last_fullsized":"2024-06-11T15:58:57.161784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.163879+0000","last_change":"2024-06-11T15:58:57.163879+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.163879+0000","last_undegraded":"2024-06-11T15:58:57.163879+0000","last_fullsized":"2024-06-11T15:58:57.163879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161421+0000","last_change":"2024-06-11T15:58:57.161421+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161421+0000","last_undegraded":"2024-06-11T15:58:57.161421+0000","last_fullsized":"2024-06-11T15:58:57.161421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161333+0000","last_change":"2024-06-11T15:58:57.161333+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161333+0000","last_undegraded":"2024-06-11T15:58:57.161333+0000","last_fullsized":"2024-06-11T15:58:57.161333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161351+0000","last_change":"2024-06-11T15:58:57.161351+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161351+0000","last_undegraded":"2024-06-11T15:58:57.161351+0000","last_fullsized":"2024-06-11T15:58:57.161351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161789+0000","last_change":"2024-06-11T15:58:57.161789+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161789+0000","last_undegraded":"2024-06-11T15:58:57.161789+0000","last_fullsized":"2024-06-11T15:58:57.161789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161834+0000","last_change":"2024-06-11T15:58:57.161834+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161834+0000","last_undegraded":"2024-06-11T15:58:57.161834+0000","last_fullsized":"2024-06-11T15:58:57.161834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.165370+0000","last_change":"2024-06-11T15:58:57.165370+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.165370+0000","last_undegraded":"2024-06-11T15:58:57.165370+0000","last_fullsized":"2024-06-11T15:58:57.165370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162544+0000","last_change":"2024-06-11T15:58:57.162544+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162544+0000","last_undegraded":"2024-06-11T15:58:57.162544+0000","last_fullsized":"2024-06-11T15:58:57.162544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.161368+0000","last_change":"2024-06-11T15:58:57.161368+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.161368+0000","last_undegraded":"2024-06-11T15:58:57.161368+0000","last_fullsized":"2024-06-11T15:58:57.161368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-11T15:58:58.156618+0000","last_change":"2024-06-11T15:58:58.156618+0000","last_active":"2024-06-11T15:58:58.156618+0000","last_peered":"2024-06-11T15:58:58.156618+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:58.156618+0000","last_undegraded":"2024-06-11T15:58:58.156618+0000","last_fullsized":"2024-06-11T15:58:58.156618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2024-06-11T15:58:57.162091+0000","last_change":"2024-06-11T15:58:57.162091+0000","last_active":"2024-06-11T15:58:57.155352+0000","last_peered":"2024-06-11T15:58:57.155352+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-11T15:58:57.162091+0000","last_undegraded":"2024-06-11T15:58:57.162091+0000","last_fullsized":"2024-06-11T15:58:57.162091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":196608,"data_stored":633569,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-06-11T15:59:02.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.37 is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-06-11T15:59:02.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-06-11T15:59:02.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2f is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2d is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-06-11T15:59:02.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:PG 4.29 is not active+clean 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:PG 4.26 is not active+clean 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-06-11T15:59:02.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.23 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.21 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-06-11T15:59:02.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.164594+0000', 'last_change': '2024-06-11T15:58:57.164594+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.164594+0000', 'last_undegraded': '2024-06-11T15:58:57.164594+0000', 'last_fullsized': '2024-06-11T15:58:57.164594+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161251+0000', 'last_change': '2024-06-11T15:58:57.161251+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161251+0000', 'last_undegraded': '2024-06-11T15:58:57.161251+0000', 'last_fullsized': '2024-06-11T15:58:57.161251+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.162411+0000', 'last_change': '2024-06-11T15:58:57.162411+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.162411+0000', 'last_undegraded': '2024-06-11T15:58:57.162411+0000', 'last_fullsized': '2024-06-11T15:58:57.162411+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.904 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163913+0000', 'last_change': '2024-06-11T15:58:57.163913+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163913+0000', 'last_undegraded': '2024-06-11T15:58:57.163913+0000', 'last_fullsized': '2024-06-11T15:58:57.163913+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163895+0000', 'last_change': '2024-06-11T15:58:57.163895+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163895+0000', 'last_undegraded': '2024-06-11T15:58:57.163895+0000', 'last_fullsized': '2024-06-11T15:58:57.163895+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161972+0000', 'last_change': '2024-06-11T15:58:57.161972+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161972+0000', 'last_undegraded': '2024-06-11T15:58:57.161972+0000', 'last_fullsized': '2024-06-11T15:58:57.161972+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-06-11T15:59:02.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.164905+0000', 'last_change': '2024-06-11T15:58:57.164905+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.164905+0000', 'last_undegraded': '2024-06-11T15:58:57.164905+0000', 'last_fullsized': '2024-06-11T15:58:57.164905+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163725+0000', 'last_change': '2024-06-11T15:58:57.163725+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163725+0000', 'last_undegraded': '2024-06-11T15:58:57.163725+0000', 'last_fullsized': '2024-06-11T15:58:57.163725+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160575+0000', 'last_change': '2024-06-11T15:58:57.160575+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160575+0000', 'last_undegraded': '2024-06-11T15:58:57.160575+0000', 'last_fullsized': '2024-06-11T15:58:57.160575+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-06-11T15:59:02.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163973+0000', 'last_change': '2024-06-11T15:58:57.163973+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163973+0000', 'last_undegraded': '2024-06-11T15:58:57.163973+0000', 'last_fullsized': '2024-06-11T15:58:57.163973+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161753+0000', 'last_change': '2024-06-11T15:58:57.161753+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161753+0000', 'last_undegraded': '2024-06-11T15:58:57.161753+0000', 'last_fullsized': '2024-06-11T15:58:57.161753+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.162492+0000', 'last_change': '2024-06-11T15:58:57.162492+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.162492+0000', 'last_undegraded': '2024-06-11T15:58:57.162492+0000', 'last_fullsized': '2024-06-11T15:58:57.162492+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-06-11T15:59:02.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160420+0000', 'last_change': '2024-06-11T15:58:57.160420+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160420+0000', 'last_undegraded': '2024-06-11T15:58:57.160420+0000', 'last_fullsized': '2024-06-11T15:58:57.160420+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160407+0000', 'last_change': '2024-06-11T15:58:57.160407+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160407+0000', 'last_undegraded': '2024-06-11T15:58:57.160407+0000', 'last_fullsized': '2024-06-11T15:58:57.160407+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161795+0000', 'last_change': '2024-06-11T15:58:57.161795+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161795+0000', 'last_undegraded': '2024-06-11T15:58:57.161795+0000', 'last_fullsized': '2024-06-11T15:58:57.161795+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-06-11T15:59:02.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163665+0000', 'last_change': '2024-06-11T15:58:57.163665+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163665+0000', 'last_undegraded': '2024-06-11T15:58:57.163665+0000', 'last_fullsized': '2024-06-11T15:58:57.163665+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163712+0000', 'last_change': '2024-06-11T15:58:57.163712+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163712+0000', 'last_undegraded': '2024-06-11T15:58:57.163712+0000', 'last_fullsized': '2024-06-11T15:58:57.163712+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160356+0000', 'last_change': '2024-06-11T15:58:57.160356+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160356+0000', 'last_undegraded': '2024-06-11T15:58:57.160356+0000', 'last_fullsized': '2024-06-11T15:58:57.160356+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-06-11T15:59:02.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160573+0000', 'last_change': '2024-06-11T15:58:57.160573+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160573+0000', 'last_undegraded': '2024-06-11T15:58:57.160573+0000', 'last_fullsized': '2024-06-11T15:58:57.160573+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.160433+0000', 'last_change': '2024-06-11T15:58:57.160433+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.160433+0000', 'last_undegraded': '2024-06-11T15:58:57.160433+0000', 'last_fullsized': '2024-06-11T15:58:57.160433+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.164776+0000', 'last_change': '2024-06-11T15:58:57.164776+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.164776+0000', 'last_undegraded': '2024-06-11T15:58:57.164776+0000', 'last_fullsized': '2024-06-11T15:58:57.164776+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161784+0000', 'last_change': '2024-06-11T15:58:57.161784+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161784+0000', 'last_undegraded': '2024-06-11T15:58:57.161784+0000', 'last_fullsized': '2024-06-11T15:58:57.161784+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.163879+0000', 'last_change': '2024-06-11T15:58:57.163879+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.163879+0000', 'last_undegraded': '2024-06-11T15:58:57.163879+0000', 'last_fullsized': '2024-06-11T15:58:57.163879+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161421+0000', 'last_change': '2024-06-11T15:58:57.161421+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161421+0000', 'last_undegraded': '2024-06-11T15:58:57.161421+0000', 'last_fullsized': '2024-06-11T15:58:57.161421+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-06-11T15:59:02.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161333+0000', 'last_change': '2024-06-11T15:58:57.161333+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161333+0000', 'last_undegraded': '2024-06-11T15:58:57.161333+0000', 'last_fullsized': '2024-06-11T15:58:57.161333+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161351+0000', 'last_change': '2024-06-11T15:58:57.161351+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161351+0000', 'last_undegraded': '2024-06-11T15:58:57.161351+0000', 'last_fullsized': '2024-06-11T15:58:57.161351+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-06-11T15:59:02.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161789+0000', 'last_change': '2024-06-11T15:58:57.161789+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161789+0000', 'last_undegraded': '2024-06-11T15:58:57.161789+0000', 'last_fullsized': '2024-06-11T15:58:57.161789+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161834+0000', 'last_change': '2024-06-11T15:58:57.161834+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161834+0000', 'last_undegraded': '2024-06-11T15:58:57.161834+0000', 'last_fullsized': '2024-06-11T15:58:57.161834+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.165370+0000', 'last_change': '2024-06-11T15:58:57.165370+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.165370+0000', 'last_undegraded': '2024-06-11T15:58:57.165370+0000', 'last_fullsized': '2024-06-11T15:58:57.165370+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-06-11T15:59:02.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.162544+0000', 'last_change': '2024-06-11T15:58:57.162544+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.162544+0000', 'last_undegraded': '2024-06-11T15:58:57.162544+0000', 'last_fullsized': '2024-06-11T15:58:57.162544+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.161368+0000', 'last_change': '2024-06-11T15:58:57.161368+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.161368+0000', 'last_undegraded': '2024-06-11T15:58:57.161368+0000', 'last_fullsized': '2024-06-11T15:58:57.161368+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-11T15:58:58.156618+0000', 'last_change': '2024-06-11T15:58:58.156618+0000', 'last_active': '2024-06-11T15:58:58.156618+0000', 'last_peered': '2024-06-11T15:58:58.156618+0000', 'last_clean': '2024-06-11T15:58:58.156618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:58.156618+0000', 'last_undegraded': '2024-06-11T15:58:58.156618+0000', 'last_fullsized': '2024-06-11T15:58:58.156618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:58.156618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-06-11T15:59:02.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2024-06-11T15:58:57.162091+0000', 'last_change': '2024-06-11T15:58:57.162091+0000', 'last_active': '2024-06-11T15:58:57.155352+0000', 'last_peered': '2024-06-11T15:58:57.155352+0000', 'last_clean': '2024-06-11T15:58:57.155352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-11T15:58:57.162091+0000', 'last_undegraded': '2024-06-11T15:58:57.162091+0000', 'last_fullsized': '2024-06-11T15:58:57.162091+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'last_clean_scrub_stamp': '2024-06-11T15:58:57.155352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-11T15:59:02.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-11T15:59:03.294 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:03.294 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":19,"num_osds":3,"num_up_osds":3,"osd_up_since":1718121527,"num_in_osds":3,"osd_in_since":1718121520,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":87801856,"bytes_avail":289822490624,"bytes_total":289910292480,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208,"read_bytes_sec":2086,"write_bytes_sec":60737,"read_op_per_sec":2,"write_op_per_sec":3},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4201}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-06-11T15:58:39.315471+0000","services":{}},"progress_events":{}} 2024-06-11T15:59:03.307 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-11T15:59:03.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:03.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:03.597 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:03.606 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-06-11T15:59:03.577433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000965"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:06.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:06.910 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:06.911 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:06.921 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-06-11T15:59:05.577932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.410152"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:06.925 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T15:59:06.925 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-11T15:59:06.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-11T15:59:06.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-11T15:59:06.926 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-11T15:59:07.300 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:07.312 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":3827377386},{"type":"v1","addr":"172.21.15.89:6801","nonce":3827377386}]},"active_addr":"172.21.15.89:6801/3827377386","active_change":"2024-06-11T15:58:43.569551+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4137,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1012743864}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":59237934}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1371823853}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3377814005}]}]} 2024-06-11T15:59:07.316 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-11T15:59:07.316 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-11T15:59:07.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:59:07.600 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:07.600 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:59:00.181412+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:59:07.613 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-11T15:59:07.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:59:07.898 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:07.898 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:59:00.181412+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:59:07.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-11T15:59:07.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-11T15:59:07.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-11T15:59:08.050 INFO:teuthology.orchestra.run.smithi089.stdout:34359738375 2024-06-11T15:59:08.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T15:59:08.070 INFO:teuthology.orchestra.run.smithi089.stdout:34359738375 2024-06-11T15:59:08.071 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T15:59:08.071 INFO:teuthology.orchestra.run.smithi089.stdout:34359738375 2024-06-11T15:59:08.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T15:59:08.352 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:08.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-06-11T15:59:08.415 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:08.416 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:08.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-06-11T15:59:08.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-06-11T15:59:09.365 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T15:59:09.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T15:59:09.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T15:59:09.687 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:09.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-06-11T15:59:09.737 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:09.744 INFO:teuthology.orchestra.run.smithi089.stdout:34359738374 2024-06-11T15:59:09.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-06-11T15:59:09.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-06-11T15:59:10.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T15:59:10.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T15:59:10.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T15:59:11.021 INFO:teuthology.orchestra.run.smithi089.stdout:34359738376 2024-06-11T15:59:11.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.1 2024-06-11T15:59:11.035 DEBUG:teuthology.parallel:result is None 2024-06-11T15:59:11.057 INFO:teuthology.orchestra.run.smithi089.stdout:34359738376 2024-06-11T15:59:11.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.2 2024-06-11T15:59:11.071 DEBUG:teuthology.parallel:result is None 2024-06-11T15:59:11.100 INFO:teuthology.orchestra.run.smithi089.stdout:34359738376 2024-06-11T15:59:11.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738376 for osd.0 2024-06-11T15:59:11.113 DEBUG:teuthology.parallel:result is None 2024-06-11T15:59:11.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T15:59:11.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:11.447 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:11.449 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:11.459 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-06-11T15:59:09.578542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001766"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:11.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:11.789 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:11.791 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:11.799 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-06-11T15:59:11.578959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.388952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:11.803 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T15:59:11.803 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-11T15:59:11.803 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-11T15:59:11.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-11T15:59:12.157 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-11T15:59:12.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-11T15:59:12.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T15:59:12.490 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:12.490 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T15:59:12.490 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T15:59:12.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T15:59:12.819 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:12.819 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T15:59:12.819 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T15:59:12.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T15:59:13.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:13.118 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T15:59:00.181412+0000","last_up_change":"2024-06-11T15:58:47.789155+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6801","nonce":443308706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6803","nonce":443308706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6807","nonce":443308706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":443308706},{"type":"v1","addr":"172.21.15.171:6805","nonce":443308706}]},"public_addr":"172.21.15.171:6801/443308706","cluster_addr":"172.21.15.171:6803/443308706","heartbeat_back_addr":"172.21.15.171:6807/443308706","heartbeat_front_addr":"172.21.15.171:6805/443308706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T15:59:13.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T15:59:13.453 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:13.454 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T15:59:13.454 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T15:59:13.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-11T15:58:58.506116+0000', 'modified': '2024-06-11T15:59:00.537380+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4201': {'gid': 4201, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.89:6803/1151219335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6802', 'nonce': 1151219335}, {'type': 'v1', 'addr': '172.21.15.89:6803', 'nonce': 1151219335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4201, 'qdb_cluster': [4201]} 2024-06-11T15:59:13.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-11T15:59:13.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-11T15:59:13.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:13.683+0000 7ff9d17fa640 0 client.4539 ms_handle_reset on v2:172.21.15.89:6802/1151219335 2024-06-11T15:59:13.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:13.705+0000 7ff9d17fa640 0 client.14357 ms_handle_reset on v2:172.21.15.89:6802/1151219335 2024-06-11T15:59:13.705 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T15:59:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T15:59:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "whoami": 0, 2024-06-11T15:59:13.705 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4201, 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "want_state": "up:active", 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "state": "up:active", 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs", 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "rank_uptime": 14.513561653, 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "mdsmap_epoch": 5, 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch": 19, 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "osdmap_epoch_barrier": 19, 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout: "uptime": 17.452453521999999 2024-06-11T15:59:13.706 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T15:59:13.717 INFO:teuthology.run_tasks:Running task thrashosds... 2024-06-11T15:59:13.731 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-06-11T15:59:13.731 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '3f51ea3944d39ca13aa40153c9a4ee298306679d'}} 2024-06-11T15:59:13.731 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-06-11T15:59:13.731 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-06-11T15:59:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sync 2024-06-11T15:59:13.867 DEBUG:teuthology.orchestra.run.smithi129:> sync 2024-06-11T15:59:13.989 DEBUG:teuthology.orchestra.run.smithi163:> sync 2024-06-11T15:59:14.045 DEBUG:teuthology.orchestra.run.smithi171:> sync 2024-06-11T15:59:14.217 DEBUG:tasks.thrashosds:checking console status of smithi089 2024-06-11T15:59:14.217 DEBUG:teuthology.orchestra.console.smithi089:Waiting for login prompt 2024-06-11T15:59:14.217 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi089 2024-06-11T15:59:14.340 DEBUG:teuthology.orchestra.console.smithi089:expect before: [Enter `^Ec?' for help] 2024-06-11T15:59:14.340 DEBUG:teuthology.orchestra.console.smithi089:expect after: smithi089 login: 2024-06-11T15:59:14.394 DEBUG:teuthology.orchestra.console.smithi089:console disconnect output: [Enter `^Ec?' for help] smithi089 login: [disconnect] 2024-06-11T15:59:14.495 DEBUG:tasks.thrashosds:checking console status of smithi129 2024-06-11T15:59:14.496 DEBUG:teuthology.orchestra.console.smithi129:Waiting for login prompt 2024-06-11T15:59:14.496 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi129 2024-06-11T15:59:14.624 DEBUG:teuthology.orchestra.console.smithi129:expect before: [Enter `^Ec?' for help] 2024-06-11T15:59:14.624 DEBUG:teuthology.orchestra.console.smithi129:expect after: smithi129 login: 2024-06-11T15:59:14.676 DEBUG:teuthology.orchestra.console.smithi129:console disconnect output: [Enter `^Ec?' for help] smithi129 login: [disconnect] 2024-06-11T15:59:14.777 DEBUG:tasks.thrashosds:checking console status of smithi163 2024-06-11T15:59:14.777 DEBUG:teuthology.orchestra.console.smithi163:Waiting for login prompt 2024-06-11T15:59:14.777 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi163 2024-06-11T15:59:14.905 DEBUG:teuthology.orchestra.console.smithi163:expect before: [Enter `^Ec?' for help] 2024-06-11T15:59:14.905 DEBUG:teuthology.orchestra.console.smithi163:expect after: smithi163 login: 2024-06-11T15:59:14.959 DEBUG:teuthology.orchestra.console.smithi163:console disconnect output: [Enter `^Ec?' for help] smithi163 login: [disconnect] 2024-06-11T15:59:15.061 DEBUG:tasks.thrashosds:checking console status of smithi171 2024-06-11T15:59:15.061 DEBUG:teuthology.orchestra.console.smithi171:Waiting for login prompt 2024-06-11T15:59:15.061 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi171 2024-06-11T15:59:15.596 DEBUG:teuthology.orchestra.console.smithi171:expect before: [Enter `^Ec?' for help] 2024-06-11T15:59:15.596 DEBUG:teuthology.orchestra.console.smithi171:expect after: smithi171 login: 2024-06-11T15:59:15.853 DEBUG:teuthology.orchestra.console.smithi171:console disconnect output: [Enter `^Ec?' for help] smithi171 login: [disconnect] 2024-06-11T15:59:15.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-06-11T15:59:16.269 INFO:tasks.thrashosds:Beginning thrashosds... 2024-06-11T15:59:16.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T15:59:16.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:16.559 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:16.561 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:16.570 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-06-11T15:59:15.579652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002218"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:16.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:16.899 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:16.900 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:16.910 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-06-11T15:59:15.579652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90040,"kb_used_data":656,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025480,"statfs":{"total":289910292480,"available":289818091520,"internally_reserved":0,"allocated":671744,"data_stored":1357696,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002218"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034620+0000","last_change":"2024-06-11T15:58:59.196291+0000","last_active":"2024-06-11T15:59:01.034620+0000","last_peered":"2024-06-11T15:59:01.034620+0000","last_clean":"2024-06-11T15:59:01.034620+0000","last_became_active":"2024-06-11T15:58:59.195602+0000","last_became_peered":"2024-06-11T15:58:59.195602+0000","last_unstale":"2024-06-11T15:59:01.034620+0000","last_undegraded":"2024-06-11T15:59:01.034620+0000","last_fullsized":"2024-06-11T15:59:01.034620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034469+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:01.034469+0000","last_peered":"2024-06-11T15:59:01.034469+0000","last_clean":"2024-06-11T15:59:01.034469+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:01.034469+0000","last_undegraded":"2024-06-11T15:59:01.034469+0000","last_fullsized":"2024-06-11T15:59:01.034469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192743+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:00.192743+0000","last_peered":"2024-06-11T15:59:00.192743+0000","last_clean":"2024-06-11T15:59:00.192743+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:00.192743+0000","last_undegraded":"2024-06-11T15:59:00.192743+0000","last_fullsized":"2024-06-11T15:59:00.192743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192376+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:00.192376+0000","last_peered":"2024-06-11T15:59:00.192376+0000","last_clean":"2024-06-11T15:59:00.192376+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:00.192376+0000","last_undegraded":"2024-06-11T15:59:00.192376+0000","last_fullsized":"2024-06-11T15:59:00.192376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034145+0000","last_change":"2024-06-11T15:58:59.192784+0000","last_active":"2024-06-11T15:59:01.034145+0000","last_peered":"2024-06-11T15:59:01.034145+0000","last_clean":"2024-06-11T15:59:01.034145+0000","last_became_active":"2024-06-11T15:58:59.192287+0000","last_became_peered":"2024-06-11T15:58:59.192287+0000","last_unstale":"2024-06-11T15:59:01.034145+0000","last_undegraded":"2024-06-11T15:59:01.034145+0000","last_fullsized":"2024-06-11T15:59:01.034145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191953+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:00.191953+0000","last_peered":"2024-06-11T15:59:00.191953+0000","last_clean":"2024-06-11T15:59:00.191953+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:00.191953+0000","last_undegraded":"2024-06-11T15:59:00.191953+0000","last_fullsized":"2024-06-11T15:59:00.191953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191928+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:00.191928+0000","last_peered":"2024-06-11T15:59:00.191928+0000","last_clean":"2024-06-11T15:59:00.191928+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:00.191928+0000","last_undegraded":"2024-06-11T15:59:00.191928+0000","last_fullsized":"2024-06-11T15:59:00.191928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191693+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:00.191693+0000","last_peered":"2024-06-11T15:59:00.191693+0000","last_clean":"2024-06-11T15:59:00.191693+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:00.191693+0000","last_undegraded":"2024-06-11T15:59:00.191693+0000","last_fullsized":"2024-06-11T15:59:00.191693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189855+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:00.189855+0000","last_peered":"2024-06-11T15:59:00.189855+0000","last_clean":"2024-06-11T15:59:00.189855+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:00.189855+0000","last_undegraded":"2024-06-11T15:59:00.189855+0000","last_fullsized":"2024-06-11T15:59:00.189855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034564+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:01.034564+0000","last_peered":"2024-06-11T15:59:01.034564+0000","last_clean":"2024-06-11T15:59:01.034564+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:01.034564+0000","last_undegraded":"2024-06-11T15:59:01.034564+0000","last_fullsized":"2024-06-11T15:59:01.034564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192627+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:00.192627+0000","last_peered":"2024-06-11T15:59:00.192627+0000","last_clean":"2024-06-11T15:59:00.192627+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:00.192627+0000","last_undegraded":"2024-06-11T15:59:00.192627+0000","last_fullsized":"2024-06-11T15:59:00.192627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033970+0000","last_change":"2024-06-11T15:58:59.204378+0000","last_active":"2024-06-11T15:59:01.033970+0000","last_peered":"2024-06-11T15:59:01.033970+0000","last_clean":"2024-06-11T15:59:01.033970+0000","last_became_active":"2024-06-11T15:58:59.204029+0000","last_became_peered":"2024-06-11T15:58:59.204029+0000","last_unstale":"2024-06-11T15:59:01.033970+0000","last_undegraded":"2024-06-11T15:59:01.033970+0000","last_fullsized":"2024-06-11T15:59:01.033970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033802+0000","last_change":"2024-06-11T15:58:59.193568+0000","last_active":"2024-06-11T15:59:01.033802+0000","last_peered":"2024-06-11T15:59:01.033802+0000","last_clean":"2024-06-11T15:59:01.033802+0000","last_became_active":"2024-06-11T15:58:59.192834+0000","last_became_peered":"2024-06-11T15:58:59.192834+0000","last_unstale":"2024-06-11T15:59:01.033802+0000","last_undegraded":"2024-06-11T15:59:01.033802+0000","last_fullsized":"2024-06-11T15:59:01.033802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:11.203232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192024+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:00.192024+0000","last_peered":"2024-06-11T15:59:00.192024+0000","last_clean":"2024-06-11T15:59:00.192024+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:00.192024+0000","last_undegraded":"2024-06-11T15:59:00.192024+0000","last_fullsized":"2024-06-11T15:59:00.192024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.191996+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:00.191996+0000","last_peered":"2024-06-11T15:59:00.191996+0000","last_clean":"2024-06-11T15:59:00.191996+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:00.191996+0000","last_undegraded":"2024-06-11T15:59:00.191996+0000","last_fullsized":"2024-06-11T15:59:00.191996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192493+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:00.192493+0000","last_peered":"2024-06-11T15:59:00.192493+0000","last_clean":"2024-06-11T15:59:00.192493+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:00.192493+0000","last_undegraded":"2024-06-11T15:59:00.192493+0000","last_fullsized":"2024-06-11T15:59:00.192493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190319+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:00.190319+0000","last_peered":"2024-06-11T15:59:00.190319+0000","last_clean":"2024-06-11T15:59:00.190319+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:00.190319+0000","last_undegraded":"2024-06-11T15:59:00.190319+0000","last_fullsized":"2024-06-11T15:59:00.190319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034768+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:01.034768+0000","last_peered":"2024-06-11T15:59:01.034768+0000","last_clean":"2024-06-11T15:59:01.034768+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:01.034768+0000","last_undegraded":"2024-06-11T15:59:01.034768+0000","last_fullsized":"2024-06-11T15:59:01.034768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189523+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:00.189523+0000","last_peered":"2024-06-11T15:59:00.189523+0000","last_clean":"2024-06-11T15:59:00.189523+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:00.189523+0000","last_undegraded":"2024-06-11T15:59:00.189523+0000","last_fullsized":"2024-06-11T15:59:00.189523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192815+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:00.192815+0000","last_peered":"2024-06-11T15:59:00.192815+0000","last_clean":"2024-06-11T15:59:00.192815+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:00.192815+0000","last_undegraded":"2024-06-11T15:59:00.192815+0000","last_fullsized":"2024-06-11T15:59:00.192815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192671+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:00.192671+0000","last_peered":"2024-06-11T15:59:00.192671+0000","last_clean":"2024-06-11T15:59:00.192671+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:00.192671+0000","last_undegraded":"2024-06-11T15:59:00.192671+0000","last_fullsized":"2024-06-11T15:59:00.192671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033576+0000","last_change":"2024-06-11T15:58:59.203931+0000","last_active":"2024-06-11T15:59:01.033576+0000","last_peered":"2024-06-11T15:59:01.033576+0000","last_clean":"2024-06-11T15:59:01.033576+0000","last_became_active":"2024-06-11T15:58:59.203445+0000","last_became_peered":"2024-06-11T15:58:59.203445+0000","last_unstale":"2024-06-11T15:59:01.033576+0000","last_undegraded":"2024-06-11T15:59:01.033576+0000","last_fullsized":"2024-06-11T15:59:01.033576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:56.966219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188827+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:00.188827+0000","last_peered":"2024-06-11T15:59:00.188827+0000","last_clean":"2024-06-11T15:59:00.188827+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:00.188827+0000","last_undegraded":"2024-06-11T15:59:00.188827+0000","last_fullsized":"2024-06-11T15:59:00.188827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033410+0000","last_change":"2024-06-11T15:58:59.195825+0000","last_active":"2024-06-11T15:59:01.033410+0000","last_peered":"2024-06-11T15:59:01.033410+0000","last_clean":"2024-06-11T15:59:01.033410+0000","last_became_active":"2024-06-11T15:58:59.195350+0000","last_became_peered":"2024-06-11T15:58:59.195350+0000","last_unstale":"2024-06-11T15:59:01.033410+0000","last_undegraded":"2024-06-11T15:59:01.033410+0000","last_fullsized":"2024-06-11T15:59:01.033410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:45:50.835789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034693+0000","last_change":"2024-06-11T15:58:59.203886+0000","last_active":"2024-06-11T15:59:01.034693+0000","last_peered":"2024-06-11T15:59:01.034693+0000","last_clean":"2024-06-11T15:59:01.034693+0000","last_became_active":"2024-06-11T15:58:59.203298+0000","last_became_peered":"2024-06-11T15:58:59.203298+0000","last_unstale":"2024-06-11T15:59:01.034693+0000","last_undegraded":"2024-06-11T15:59:01.034693+0000","last_fullsized":"2024-06-11T15:59:01.034693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189883+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:00.189883+0000","last_peered":"2024-06-11T15:59:00.189883+0000","last_clean":"2024-06-11T15:59:00.189883+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:00.189883+0000","last_undegraded":"2024-06-11T15:59:00.189883+0000","last_fullsized":"2024-06-11T15:59:00.189883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193068+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:00.193068+0000","last_peered":"2024-06-11T15:59:00.193068+0000","last_clean":"2024-06-11T15:59:00.193068+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:00.193068+0000","last_undegraded":"2024-06-11T15:59:00.193068+0000","last_fullsized":"2024-06-11T15:59:00.193068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034395+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:01.034395+0000","last_peered":"2024-06-11T15:59:01.034395+0000","last_clean":"2024-06-11T15:59:01.034395+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:01.034395+0000","last_undegraded":"2024-06-11T15:59:01.034395+0000","last_fullsized":"2024-06-11T15:59:01.034395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189659+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:00.189659+0000","last_peered":"2024-06-11T15:59:00.189659+0000","last_clean":"2024-06-11T15:59:00.189659+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:00.189659+0000","last_undegraded":"2024-06-11T15:59:00.189659+0000","last_fullsized":"2024-06-11T15:59:00.189659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034040+0000","last_change":"2024-06-11T15:58:59.203530+0000","last_active":"2024-06-11T15:59:01.034040+0000","last_peered":"2024-06-11T15:59:01.034040+0000","last_clean":"2024-06-11T15:59:01.034040+0000","last_became_active":"2024-06-11T15:58:59.202946+0000","last_became_peered":"2024-06-11T15:58:59.202946+0000","last_unstale":"2024-06-11T15:59:01.034040+0000","last_undegraded":"2024-06-11T15:59:01.034040+0000","last_fullsized":"2024-06-11T15:59:01.034040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189000+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:00.189000+0000","last_peered":"2024-06-11T15:59:00.189000+0000","last_clean":"2024-06-11T15:59:00.189000+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:00.189000+0000","last_undegraded":"2024-06-11T15:59:00.189000+0000","last_fullsized":"2024-06-11T15:59:00.189000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192020+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:00.192020+0000","last_peered":"2024-06-11T15:59:00.192020+0000","last_clean":"2024-06-11T15:59:00.192020+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:00.192020+0000","last_undegraded":"2024-06-11T15:59:00.192020+0000","last_fullsized":"2024-06-11T15:59:00.192020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034228+0000","last_change":"2024-06-11T15:58:59.195656+0000","last_active":"2024-06-11T15:59:01.034228+0000","last_peered":"2024-06-11T15:59:01.034228+0000","last_clean":"2024-06-11T15:59:01.034228+0000","last_became_active":"2024-06-11T15:58:59.195165+0000","last_became_peered":"2024-06-11T15:58:59.195165+0000","last_unstale":"2024-06-11T15:59:01.034228+0000","last_undegraded":"2024-06-11T15:59:01.034228+0000","last_fullsized":"2024-06-11T15:59:01.034228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192942+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:00.192942+0000","last_peered":"2024-06-11T15:59:00.192942+0000","last_clean":"2024-06-11T15:59:00.192942+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:00.192942+0000","last_undegraded":"2024-06-11T15:59:00.192942+0000","last_fullsized":"2024-06-11T15:59:00.192942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034688+0000","last_change":"2024-06-11T15:58:59.194199+0000","last_active":"2024-06-11T15:59:01.034688+0000","last_peered":"2024-06-11T15:59:01.034688+0000","last_clean":"2024-06-11T15:59:01.034688+0000","last_became_active":"2024-06-11T15:58:59.192971+0000","last_became_peered":"2024-06-11T15:58:59.192971+0000","last_unstale":"2024-06-11T15:59:01.034688+0000","last_undegraded":"2024-06-11T15:59:01.034688+0000","last_fullsized":"2024-06-11T15:59:01.034688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189109+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:00.189109+0000","last_peered":"2024-06-11T15:59:00.189109+0000","last_clean":"2024-06-11T15:59:00.189109+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:00.189109+0000","last_undegraded":"2024-06-11T15:59:00.189109+0000","last_fullsized":"2024-06-11T15:59:00.189109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190107+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:00.190107+0000","last_peered":"2024-06-11T15:59:00.190107+0000","last_clean":"2024-06-11T15:59:00.190107+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:00.190107+0000","last_undegraded":"2024-06-11T15:59:00.190107+0000","last_fullsized":"2024-06-11T15:59:00.190107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033729+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:01.033729+0000","last_peered":"2024-06-11T15:59:01.033729+0000","last_clean":"2024-06-11T15:59:01.033729+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:01.033729+0000","last_undegraded":"2024-06-11T15:59:01.033729+0000","last_fullsized":"2024-06-11T15:59:01.033729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189919+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:00.189919+0000","last_peered":"2024-06-11T15:59:00.189919+0000","last_clean":"2024-06-11T15:59:00.189919+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:00.189919+0000","last_undegraded":"2024-06-11T15:59:00.189919+0000","last_fullsized":"2024-06-11T15:59:00.189919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192097+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:00.192097+0000","last_peered":"2024-06-11T15:59:00.192097+0000","last_clean":"2024-06-11T15:59:00.192097+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:00.192097+0000","last_undegraded":"2024-06-11T15:59:00.192097+0000","last_fullsized":"2024-06-11T15:59:00.192097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192594+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:00.192594+0000","last_peered":"2024-06-11T15:59:00.192594+0000","last_clean":"2024-06-11T15:59:00.192594+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:00.192594+0000","last_undegraded":"2024-06-11T15:59:00.192594+0000","last_fullsized":"2024-06-11T15:59:00.192594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033413+0000","last_change":"2024-06-11T15:58:59.204764+0000","last_active":"2024-06-11T15:59:01.033413+0000","last_peered":"2024-06-11T15:59:01.033413+0000","last_clean":"2024-06-11T15:59:01.033413+0000","last_became_active":"2024-06-11T15:58:59.204441+0000","last_became_peered":"2024-06-11T15:58:59.204441+0000","last_unstale":"2024-06-11T15:59:01.033413+0000","last_undegraded":"2024-06-11T15:59:01.033413+0000","last_fullsized":"2024-06-11T15:59:01.033413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:23:37.217723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034826+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:01.034826+0000","last_peered":"2024-06-11T15:59:01.034826+0000","last_clean":"2024-06-11T15:59:01.034826+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:01.034826+0000","last_undegraded":"2024-06-11T15:59:01.034826+0000","last_fullsized":"2024-06-11T15:59:01.034826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033730+0000","last_change":"2024-06-11T15:58:59.193743+0000","last_active":"2024-06-11T15:59:01.033730+0000","last_peered":"2024-06-11T15:59:01.033730+0000","last_clean":"2024-06-11T15:59:01.033730+0000","last_became_active":"2024-06-11T15:58:59.192884+0000","last_became_peered":"2024-06-11T15:58:59.192884+0000","last_unstale":"2024-06-11T15:59:01.033730+0000","last_undegraded":"2024-06-11T15:59:01.033730+0000","last_fullsized":"2024-06-11T15:59:01.033730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:39:31.417653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193142+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:00.193142+0000","last_peered":"2024-06-11T15:59:00.193142+0000","last_clean":"2024-06-11T15:59:00.193142+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:00.193142+0000","last_undegraded":"2024-06-11T15:59:00.193142+0000","last_fullsized":"2024-06-11T15:59:00.193142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192198+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:00.192198+0000","last_peered":"2024-06-11T15:59:00.192198+0000","last_clean":"2024-06-11T15:59:00.192198+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:00.192198+0000","last_undegraded":"2024-06-11T15:59:00.192198+0000","last_fullsized":"2024-06-11T15:59:00.192198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193080+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:00.193080+0000","last_peered":"2024-06-11T15:59:00.193080+0000","last_clean":"2024-06-11T15:59:00.193080+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:00.193080+0000","last_undegraded":"2024-06-11T15:59:00.193080+0000","last_fullsized":"2024-06-11T15:59:00.193080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189869+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:00.189869+0000","last_peered":"2024-06-11T15:59:00.189869+0000","last_clean":"2024-06-11T15:59:00.189869+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:00.189869+0000","last_undegraded":"2024-06-11T15:59:00.189869+0000","last_fullsized":"2024-06-11T15:59:00.189869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189852+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:00.189852+0000","last_peered":"2024-06-11T15:59:00.189852+0000","last_clean":"2024-06-11T15:59:00.189852+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:00.189852+0000","last_undegraded":"2024-06-11T15:59:00.189852+0000","last_fullsized":"2024-06-11T15:59:00.189852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192837+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:00.192837+0000","last_peered":"2024-06-11T15:59:00.192837+0000","last_clean":"2024-06-11T15:59:00.192837+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:00.192837+0000","last_undegraded":"2024-06-11T15:59:00.192837+0000","last_fullsized":"2024-06-11T15:59:00.192837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192928+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:00.192928+0000","last_peered":"2024-06-11T15:59:00.192928+0000","last_clean":"2024-06-11T15:59:00.192928+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:00.192928+0000","last_undegraded":"2024-06-11T15:59:00.192928+0000","last_fullsized":"2024-06-11T15:59:00.192928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193065+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:00.193065+0000","last_peered":"2024-06-11T15:59:00.193065+0000","last_clean":"2024-06-11T15:59:00.193065+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:00.193065+0000","last_undegraded":"2024-06-11T15:59:00.193065+0000","last_fullsized":"2024-06-11T15:59:00.193065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033848+0000","last_change":"2024-06-11T15:58:58.178023+0000","last_active":"2024-06-11T15:59:01.033848+0000","last_peered":"2024-06-11T15:59:01.033848+0000","last_clean":"2024-06-11T15:59:01.033848+0000","last_became_active":"2024-06-11T15:58:58.177575+0000","last_became_peered":"2024-06-11T15:58:58.177575+0000","last_unstale":"2024-06-11T15:59:01.033848+0000","last_undegraded":"2024-06-11T15:59:01.033848+0000","last_fullsized":"2024-06-11T15:59:01.033848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:31:50.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192501+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:00.192501+0000","last_peered":"2024-06-11T15:59:00.192501+0000","last_clean":"2024-06-11T15:59:00.192501+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:00.192501+0000","last_undegraded":"2024-06-11T15:59:00.192501+0000","last_fullsized":"2024-06-11T15:59:00.192501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033495+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:01.033495+0000","last_peered":"2024-06-11T15:59:01.033495+0000","last_clean":"2024-06-11T15:59:01.033495+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:01.033495+0000","last_undegraded":"2024-06-11T15:59:01.033495+0000","last_fullsized":"2024-06-11T15:59:01.033495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190042+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:00.190042+0000","last_peered":"2024-06-11T15:59:00.190042+0000","last_clean":"2024-06-11T15:59:00.190042+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:00.190042+0000","last_undegraded":"2024-06-11T15:59:00.190042+0000","last_fullsized":"2024-06-11T15:59:00.190042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":221,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192873+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:00.192873+0000","last_peered":"2024-06-11T15:59:00.192873+0000","last_clean":"2024-06-11T15:59:00.192873+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:00.192873+0000","last_undegraded":"2024-06-11T15:59:00.192873+0000","last_fullsized":"2024-06-11T15:59:00.192873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193088+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:00.193088+0000","last_peered":"2024-06-11T15:59:00.193088+0000","last_clean":"2024-06-11T15:59:00.193088+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:00.193088+0000","last_undegraded":"2024-06-11T15:59:00.193088+0000","last_fullsized":"2024-06-11T15:59:00.193088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189230+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:00.189230+0000","last_peered":"2024-06-11T15:59:00.189230+0000","last_clean":"2024-06-11T15:59:00.189230+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:00.189230+0000","last_undegraded":"2024-06-11T15:59:00.189230+0000","last_fullsized":"2024-06-11T15:59:00.189230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193237+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:00.193237+0000","last_peered":"2024-06-11T15:59:00.193237+0000","last_clean":"2024-06-11T15:59:00.193237+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:00.193237+0000","last_undegraded":"2024-06-11T15:59:00.193237+0000","last_fullsized":"2024-06-11T15:59:00.193237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192564+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:00.192564+0000","last_peered":"2024-06-11T15:59:00.192564+0000","last_clean":"2024-06-11T15:59:00.192564+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:00.192564+0000","last_undegraded":"2024-06-11T15:59:00.192564+0000","last_fullsized":"2024-06-11T15:59:00.192564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189342+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:00.189342+0000","last_peered":"2024-06-11T15:59:00.189342+0000","last_clean":"2024-06-11T15:59:00.189342+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:00.189342+0000","last_undegraded":"2024-06-11T15:59:00.189342+0000","last_fullsized":"2024-06-11T15:59:00.189342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034663+0000","last_change":"2024-06-11T15:58:59.195663+0000","last_active":"2024-06-11T15:59:01.034663+0000","last_peered":"2024-06-11T15:59:01.034663+0000","last_clean":"2024-06-11T15:59:01.034663+0000","last_became_active":"2024-06-11T15:58:59.194770+0000","last_became_peered":"2024-06-11T15:58:59.194770+0000","last_unstale":"2024-06-11T15:59:01.034663+0000","last_undegraded":"2024-06-11T15:59:01.034663+0000","last_fullsized":"2024-06-11T15:59:01.034663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189473+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:00.189473+0000","last_peered":"2024-06-11T15:59:00.189473+0000","last_clean":"2024-06-11T15:59:00.189473+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:00.189473+0000","last_undegraded":"2024-06-11T15:59:00.189473+0000","last_fullsized":"2024-06-11T15:59:00.189473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033612+0000","last_change":"2024-06-11T15:58:58.179271+0000","last_active":"2024-06-11T15:59:01.033612+0000","last_peered":"2024-06-11T15:59:01.033612+0000","last_clean":"2024-06-11T15:59:01.033612+0000","last_became_active":"2024-06-11T15:58:58.178724+0000","last_became_peered":"2024-06-11T15:58:58.178724+0000","last_unstale":"2024-06-11T15:59:01.033612+0000","last_undegraded":"2024-06-11T15:59:01.033612+0000","last_fullsized":"2024-06-11T15:59:01.033612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:11.392365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190083+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:00.190083+0000","last_peered":"2024-06-11T15:59:00.190083+0000","last_clean":"2024-06-11T15:59:00.190083+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:00.190083+0000","last_undegraded":"2024-06-11T15:59:00.190083+0000","last_fullsized":"2024-06-11T15:59:00.190083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193000+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:00.193000+0000","last_peered":"2024-06-11T15:59:00.193000+0000","last_clean":"2024-06-11T15:59:00.193000+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:00.193000+0000","last_undegraded":"2024-06-11T15:59:00.193000+0000","last_fullsized":"2024-06-11T15:59:00.193000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192943+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:00.192943+0000","last_peered":"2024-06-11T15:59:00.192943+0000","last_clean":"2024-06-11T15:59:00.192943+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:00.192943+0000","last_undegraded":"2024-06-11T15:59:00.192943+0000","last_fullsized":"2024-06-11T15:59:00.192943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189745+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:00.189745+0000","last_peered":"2024-06-11T15:59:00.189745+0000","last_clean":"2024-06-11T15:59:00.189745+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:00.189745+0000","last_undegraded":"2024-06-11T15:59:00.189745+0000","last_fullsized":"2024-06-11T15:59:00.189745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193259+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:00.193259+0000","last_peered":"2024-06-11T15:59:00.193259+0000","last_clean":"2024-06-11T15:59:00.193259+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:00.193259+0000","last_undegraded":"2024-06-11T15:59:00.193259+0000","last_fullsized":"2024-06-11T15:59:00.193259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189778+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:00.189778+0000","last_peered":"2024-06-11T15:59:00.189778+0000","last_clean":"2024-06-11T15:59:00.189778+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:00.189778+0000","last_undegraded":"2024-06-11T15:59:00.189778+0000","last_fullsized":"2024-06-11T15:59:00.189778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033989+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:01.033989+0000","last_peered":"2024-06-11T15:59:01.033989+0000","last_clean":"2024-06-11T15:59:01.033989+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:01.033989+0000","last_undegraded":"2024-06-11T15:59:01.033989+0000","last_fullsized":"2024-06-11T15:59:01.033989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189633+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:00.189633+0000","last_peered":"2024-06-11T15:59:00.189633+0000","last_clean":"2024-06-11T15:59:00.189633+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:00.189633+0000","last_undegraded":"2024-06-11T15:59:00.189633+0000","last_fullsized":"2024-06-11T15:59:00.189633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034938+0000","last_change":"2024-06-11T15:58:56.163000+0000","last_active":"2024-06-11T15:59:01.034938+0000","last_peered":"2024-06-11T15:59:01.034938+0000","last_clean":"2024-06-11T15:59:01.034938+0000","last_became_active":"2024-06-11T15:58:56.162722+0000","last_became_peered":"2024-06-11T15:58:56.162722+0000","last_unstale":"2024-06-11T15:59:01.034938+0000","last_undegraded":"2024-06-11T15:59:01.034938+0000","last_fullsized":"2024-06-11T15:59:01.034938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:17.627641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034050+0000","last_change":"2024-06-11T15:58:59.203874+0000","last_active":"2024-06-11T15:59:01.034050+0000","last_peered":"2024-06-11T15:59:01.034050+0000","last_clean":"2024-06-11T15:59:01.034050+0000","last_became_active":"2024-06-11T15:58:59.203470+0000","last_became_peered":"2024-06-11T15:58:59.203470+0000","last_unstale":"2024-06-11T15:59:01.034050+0000","last_undegraded":"2024-06-11T15:59:01.034050+0000","last_fullsized":"2024-06-11T15:59:01.034050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190318+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:00.190318+0000","last_peered":"2024-06-11T15:59:00.190318+0000","last_clean":"2024-06-11T15:59:00.190318+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:00.190318+0000","last_undegraded":"2024-06-11T15:59:00.190318+0000","last_fullsized":"2024-06-11T15:59:00.190318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190148+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:00.190148+0000","last_peered":"2024-06-11T15:59:00.190148+0000","last_clean":"2024-06-11T15:59:00.190148+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:00.190148+0000","last_undegraded":"2024-06-11T15:59:00.190148+0000","last_fullsized":"2024-06-11T15:59:00.190148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189019+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:00.189019+0000","last_peered":"2024-06-11T15:59:00.189019+0000","last_clean":"2024-06-11T15:59:00.189019+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:00.189019+0000","last_undegraded":"2024-06-11T15:59:00.189019+0000","last_fullsized":"2024-06-11T15:59:00.189019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190141+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:00.190141+0000","last_peered":"2024-06-11T15:59:00.190141+0000","last_clean":"2024-06-11T15:59:00.190141+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:00.190141+0000","last_undegraded":"2024-06-11T15:59:00.190141+0000","last_fullsized":"2024-06-11T15:59:00.190141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192630+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:00.192630+0000","last_peered":"2024-06-11T15:59:00.192630+0000","last_clean":"2024-06-11T15:59:00.192630+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:00.192630+0000","last_undegraded":"2024-06-11T15:59:00.192630+0000","last_fullsized":"2024-06-11T15:59:00.192630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.033660+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:01.033660+0000","last_peered":"2024-06-11T15:59:01.033660+0000","last_clean":"2024-06-11T15:59:01.033660+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:01.033660+0000","last_undegraded":"2024-06-11T15:59:01.033660+0000","last_fullsized":"2024-06-11T15:59:01.033660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192857+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:00.192857+0000","last_peered":"2024-06-11T15:59:00.192857+0000","last_clean":"2024-06-11T15:59:00.192857+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:00.192857+0000","last_undegraded":"2024-06-11T15:59:00.192857+0000","last_fullsized":"2024-06-11T15:59:00.192857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.193002+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:00.193002+0000","last_peered":"2024-06-11T15:59:00.193002+0000","last_clean":"2024-06-11T15:59:00.193002+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:00.193002+0000","last_undegraded":"2024-06-11T15:59:00.193002+0000","last_fullsized":"2024-06-11T15:59:00.193002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189077+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:00.189077+0000","last_peered":"2024-06-11T15:59:00.189077+0000","last_clean":"2024-06-11T15:59:00.189077+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:00.189077+0000","last_undegraded":"2024-06-11T15:59:00.189077+0000","last_fullsized":"2024-06-11T15:59:00.189077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034801+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:01.034801+0000","last_peered":"2024-06-11T15:59:01.034801+0000","last_clean":"2024-06-11T15:59:01.034801+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:01.034801+0000","last_undegraded":"2024-06-11T15:59:01.034801+0000","last_fullsized":"2024-06-11T15:59:01.034801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192618+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:00.192618+0000","last_peered":"2024-06-11T15:59:00.192618+0000","last_clean":"2024-06-11T15:59:00.192618+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:00.192618+0000","last_undegraded":"2024-06-11T15:59:00.192618+0000","last_fullsized":"2024-06-11T15:59:00.192618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189153+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:00.189153+0000","last_peered":"2024-06-11T15:59:00.189153+0000","last_clean":"2024-06-11T15:59:00.189153+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:00.189153+0000","last_undegraded":"2024-06-11T15:59:00.189153+0000","last_fullsized":"2024-06-11T15:59:00.189153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190224+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:00.190224+0000","last_peered":"2024-06-11T15:59:00.190224+0000","last_clean":"2024-06-11T15:59:00.190224+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:00.190224+0000","last_undegraded":"2024-06-11T15:59:00.190224+0000","last_fullsized":"2024-06-11T15:59:00.190224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188920+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:00.188920+0000","last_peered":"2024-06-11T15:59:00.188920+0000","last_clean":"2024-06-11T15:59:00.188920+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:00.188920+0000","last_undegraded":"2024-06-11T15:59:00.188920+0000","last_fullsized":"2024-06-11T15:59:00.188920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034782+0000","last_change":"2024-06-11T15:58:59.203377+0000","last_active":"2024-06-11T15:59:01.034782+0000","last_peered":"2024-06-11T15:59:01.034782+0000","last_clean":"2024-06-11T15:59:01.034782+0000","last_became_active":"2024-06-11T15:58:59.203001+0000","last_became_peered":"2024-06-11T15:58:59.203001+0000","last_unstale":"2024-06-11T15:59:01.034782+0000","last_undegraded":"2024-06-11T15:59:01.034782+0000","last_fullsized":"2024-06-11T15:59:01.034782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.188985+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:00.188985+0000","last_peered":"2024-06-11T15:59:00.188985+0000","last_clean":"2024-06-11T15:59:00.188985+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:00.188985+0000","last_undegraded":"2024-06-11T15:59:00.188985+0000","last_fullsized":"2024-06-11T15:59:00.188985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189982+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:00.189982+0000","last_peered":"2024-06-11T15:59:00.189982+0000","last_clean":"2024-06-11T15:59:00.189982+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:00.189982+0000","last_undegraded":"2024-06-11T15:59:00.189982+0000","last_fullsized":"2024-06-11T15:59:00.189982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.189218+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:00.189218+0000","last_peered":"2024-06-11T15:59:00.189218+0000","last_clean":"2024-06-11T15:59:00.189218+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:00.189218+0000","last_undegraded":"2024-06-11T15:59:00.189218+0000","last_fullsized":"2024-06-11T15:59:00.189218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034591+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:01.034591+0000","last_peered":"2024-06-11T15:59:01.034591+0000","last_clean":"2024-06-11T15:59:01.034591+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:01.034591+0000","last_undegraded":"2024-06-11T15:59:01.034591+0000","last_fullsized":"2024-06-11T15:59:01.034591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034086+0000","last_change":"2024-06-11T15:58:58.181785+0000","last_active":"2024-06-11T15:59:01.034086+0000","last_peered":"2024-06-11T15:59:01.034086+0000","last_clean":"2024-06-11T15:59:01.034086+0000","last_became_active":"2024-06-11T15:58:58.181507+0000","last_became_peered":"2024-06-11T15:58:58.181507+0000","last_unstale":"2024-06-11T15:59:01.034086+0000","last_undegraded":"2024-06-11T15:59:01.034086+0000","last_fullsized":"2024-06-11T15:59:01.034086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:15.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034071+0000","last_change":"2024-06-11T15:58:59.195918+0000","last_active":"2024-06-11T15:59:01.034071+0000","last_peered":"2024-06-11T15:59:01.034071+0000","last_clean":"2024-06-11T15:59:01.034071+0000","last_became_active":"2024-06-11T15:58:59.195095+0000","last_became_peered":"2024-06-11T15:58:59.195095+0000","last_unstale":"2024-06-11T15:59:01.034071+0000","last_undegraded":"2024-06-11T15:59:01.034071+0000","last_fullsized":"2024-06-11T15:59:01.034071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034236+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:01.034236+0000","last_peered":"2024-06-11T15:59:01.034236+0000","last_clean":"2024-06-11T15:59:01.034236+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:01.034236+0000","last_undegraded":"2024-06-11T15:59:01.034236+0000","last_fullsized":"2024-06-11T15:59:01.034236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192132+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:00.192132+0000","last_peered":"2024-06-11T15:59:00.192132+0000","last_clean":"2024-06-11T15:59:00.192132+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:00.192132+0000","last_undegraded":"2024-06-11T15:59:00.192132+0000","last_fullsized":"2024-06-11T15:59:00.192132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192908+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:00.192908+0000","last_peered":"2024-06-11T15:59:00.192908+0000","last_clean":"2024-06-11T15:59:00.192908+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:00.192908+0000","last_undegraded":"2024-06-11T15:59:00.192908+0000","last_fullsized":"2024-06-11T15:59:00.192908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192883+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:00.192883+0000","last_peered":"2024-06-11T15:59:00.192883+0000","last_clean":"2024-06-11T15:59:00.192883+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:00.192883+0000","last_undegraded":"2024-06-11T15:59:00.192883+0000","last_fullsized":"2024-06-11T15:59:00.192883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034669+0000","last_change":"2024-06-11T15:58:58.176912+0000","last_active":"2024-06-11T15:59:01.034669+0000","last_peered":"2024-06-11T15:59:01.034669+0000","last_clean":"2024-06-11T15:59:01.034669+0000","last_became_active":"2024-06-11T15:58:58.176555+0000","last_became_peered":"2024-06-11T15:58:58.176555+0000","last_unstale":"2024-06-11T15:59:01.034669+0000","last_undegraded":"2024-06-11T15:59:01.034669+0000","last_fullsized":"2024-06-11T15:59:01.034669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:18:46.676853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:01.034055+0000","last_change":"2024-06-11T15:58:59.194070+0000","last_active":"2024-06-11T15:59:01.034055+0000","last_peered":"2024-06-11T15:59:01.034055+0000","last_clean":"2024-06-11T15:59:01.034055+0000","last_became_active":"2024-06-11T15:58:59.192796+0000","last_became_peered":"2024-06-11T15:58:59.192796+0000","last_unstale":"2024-06-11T15:59:01.034055+0000","last_undegraded":"2024-06-11T15:59:01.034055+0000","last_fullsized":"2024-06-11T15:59:01.034055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190007+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:00.190007+0000","last_peered":"2024-06-11T15:59:00.190007+0000","last_clean":"2024-06-11T15:59:00.190007+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:00.190007+0000","last_undegraded":"2024-06-11T15:59:00.190007+0000","last_fullsized":"2024-06-11T15:59:00.190007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.192824+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:00.192824+0000","last_peered":"2024-06-11T15:59:00.192824+0000","last_clean":"2024-06-11T15:59:00.192824+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:00.192824+0000","last_undegraded":"2024-06-11T15:59:00.192824+0000","last_fullsized":"2024-06-11T15:59:00.192824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-06-11T15:59:00.190105+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:00.190105+0000","last_peered":"2024-06-11T15:59:00.190105+0000","last_clean":"2024-06-11T15:59:00.190105+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:00.190105+0000","last_undegraded":"2024-06-11T15:59:00.190105+0000","last_fullsized":"2024-06-11T15:59:00.190105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":650158,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":649542,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":57996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:16.914 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T15:59:16.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-06-11T15:59:17.234 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 19 2024-06-11T15:59:17.234 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 48aab8a4-b456-497c-bad9-c7e7b823c20e 2024-06-11T15:59:17.234 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-06-11T15:58:39.314448+0000 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-06-11T15:59:00.181412+0000 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:crush_version 4 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:full_ratio 0.95 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:backfillfull_ratio 0.9 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:nearfull_ratio 0.85 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:require_min_compat_client luminous 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:min_compat_client jewel 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:require_osd_release squid 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:stretch_mode_enabled false 2024-06-11T15:59:17.235 INFO:teuthology.orchestra.run.smithi089.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:max_osd 3 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/4055503049,v1:172.21.15.129:6801/4055503049] [v2:172.21.15.129:6802/4055503049,v1:172.21.15.129:6803/4055503049] exists,up ef58ea1e-862f-4fd9-b48e-87a3ca753c8c 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/4023662438,v1:172.21.15.163:6801/4023662438] [v2:172.21.15.163:6802/4023662438,v1:172.21.15.163:6803/4023662438] exists,up 28556a85-d5a7-40a9-89e8-3a45e8eaaa35 2024-06-11T15:59:17.236 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/443308706,v1:172.21.15.171:6801/443308706] [v2:172.21.15.171:6802/443308706,v1:172.21.15.171:6803/443308706] exists,up 95d745de-187c-44a3-a4b1-a203f06a1cc8 2024-06-11T15:59:17.247 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.129:6800/4055503049,v1:172.21.15.129:6801/4055503049] [v2:172.21.15.129:6802/4055503049,v1:172.21.15.129:6803/4055503049] exists,up ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/4023662438,v1:172.21.15.163:6801/4023662438] [v2:172.21.15.163:6802/4023662438,v1:172.21.15.163:6803/4023662438] exists,up 28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/443308706,v1:172.21.15.171:6801/443308706] [v2:172.21.15.171:6802/443308706,v1:172.21.15.171:6803/443308706] exists,up 95d745de-187c-44a3-a4b1-a203f06a1cc8'] 2024-06-11T15:59:17.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-06-11T15:59:17.347 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T15:59:17.347 INFO:teuthology.orchestra.run.smithi089.stdout: "name": "mon.a", 2024-06-11T15:59:17.347 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster": "ceph", 2024-06-11T15:59:17.347 INFO:teuthology.orchestra.run.smithi089.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "admin_socket_mode": "", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_client_required": "cephx, none", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_cluster_required": "cephx", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_debug": "true", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_service_required": "cephx", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_service_ticket_ttl": "240.000000", 2024-06-11T15:59:17.348 INFO:teuthology.orchestra.run.smithi089.stdout: "auth_supported": "cephx", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio": "true", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_max_queue_depth": "1024", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_poll_ms": "250", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_aio_reap_max": "16", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_async_discard": "false", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_block_size": "4096", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio": "false", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_debug_inflight_ios": "false", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_enable_discard": "false", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_flock_retry": "3", 2024-06-11T15:59:17.349 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_flock_retry_interval": "0.100000", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_inject_crash": "0", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_inject_crash_flush_delay": "2", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring": "false", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring_hipri": "false", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_ioring_sqthread_poll": "false", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_read_buffer_alignment": "4096", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bdev_type": "", 2024-06-11T15:59:17.350 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_alloc_size": "1048576", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_allocator": "hybrid", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_buffered_io": "true", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_for_zeros": "false", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_volume_selector_often": "false", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_compact_log_sync": "false", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_compact_min_size": "16777216", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_log_replay_check_allocations": "true", 2024-06-11T15:59:17.351 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_max_log_runway": "4194304", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_max_prefetch": "1048576", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_min_flush_size": "524288", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_min_log_runway": "1048576", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_replay_recovery": "false", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_shared_alloc_size": "65536", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluefs_sync_write": "false", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-06-11T15:59:17.352 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_allocation_from_file": "true", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_allocator": "hybrid", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_blobid_prealloc": "10240", 2024-06-11T15:59:17.353 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_create": "true", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_create": "false", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_path": "", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_db_size": "0", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_path": "", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_preallocate_file": "false", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_size": "107374182400", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_create": "false", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_path": "", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_block_wal_size": "100663296", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs": "true", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-06-11T15:59:17.354 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_env_mirror": "false", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_autotune": "true", 2024-06-11T15:59:17.355 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size": "0", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cache_type": "2q", 2024-06-11T15:59:17.356 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_clone_cow": "true", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_algorithm": "snappy", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size": "0", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size": "0", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_mode": "none", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-06-11T15:59:17.357 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_csum_type": "crc32c", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_enforce_settings": "default", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_freelist": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_fsck_abort": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_inject_read_err": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_legacy_omap": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-06-11T15:59:17.358 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_prefill": "0.000000", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_small_allocations": "0", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_default_buffered_read": "true", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_default_buffered_write": "false", 2024-06-11T15:59:17.359 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops": "0", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_elastic_shared_blobs": "true", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fail_eio": "false", 2024-06-11T15:59:17.360 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mkfs": "true", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mount": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_umount": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-06-11T15:59:17.361 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_ignore_data_csum": "false", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_kvbackend": "rocksdb", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-06-11T15:59:17.362 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_log_op_age": "5.000000", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_alloc_size": "0", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size": "0", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_defer_interval": "3.000000", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_max_deferred_txc": "32", 2024-06-11T15:59:17.363 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size": "0", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_nid_prealloc": "1024", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size": "0", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_qfsck_on_mount": "true", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_retry_disk_reads": "3", 2024-06-11T15:59:17.364 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_cf": "true", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_rocksdb_options_annex": "", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_coremask": "0x1", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_io_sleep": "5", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_max_io_completion": "0", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_spdk_mem": "512", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_sync_submit_transaction": "false", 2024-06-11T15:59:17.365 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_bytes": "67108864", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io": "0", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_tracing": "false", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_reserved": "0", 2024-06-11T15:59:17.366 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "bluestore_zero_block_detection": "false", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_action_update_interval": "2", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-06-11T15:59:17.367 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_mount_timeout": "10", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_cluster_require_signatures": "false", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_cluster_require_version": "2", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_require_signatures": "false", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_require_version": "2", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_service_require_signatures": "false", 2024-06-11T15:59:17.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_service_require_version": "2", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "cephx_sign_messages": "true", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "chdir": "", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_acl_type": "", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_asio_thread_count": "2", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_cache_mid": "0.750000", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_cache_size": "16384", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_caps_release_delay": "5", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_check_pool_perm": "true", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_collect_and_send_global_metrics": "false", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_force_sync_read": "false", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_getattr_caps": "false", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_inject_features": "", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_debug_inject_tick_delay": "0", 2024-06-11T15:59:17.369 INFO:teuthology.orchestra.run.smithi089.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_die_on_failed_remount": "false", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_dirsize_rbytes": "true", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_force_lazyio": "false", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_fs": "", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_inject_fixed_oldest_tid": "false", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_inject_release_failure": "false", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_max_inline_size": "4096", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_max_retries_on_remount_failure": "5", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mds_namespace": "", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_metadata": "", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_gid": "-1", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_timeout": "300", 2024-06-11T15:59:17.370 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mount_uid": "-1", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_mountpoint": "/", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_notify_timeout": "10", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc": "true", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_dirty": "104857600", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_dirty_age": "5.000000", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_max_objects": "1000", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_size": "209715200", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_oc_target_dirty": "8388608", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_permissions": "true", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_quota": "true", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_quota_df": "true", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_max_bytes": "0", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_max_periods": "4", 2024-06-11T15:59:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: "client_readahead_min": "131072", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_reconnect_stale": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_shutdown_timeout": "30", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_snapdir": ".snap", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_tick_interval": "1", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_trace": "", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_try_dentry_invalidate": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_use_faked_inos": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "client_use_random_mds": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_graylog_port": "12201", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_monitors": "default=true", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog": "false", 2024-06-11T15:59:17.372 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "clog_to_syslog_level": "info", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "-", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_network": "", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_network_interface": "", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_isal": "false", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_level": "5", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zlib_winsize": "-15", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "compressor_zstd_level": "1", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_alien_op_num_threads": "6", 2024-06-11T15:59:17.373 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_alien_thread_cpu_cores": "", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_obc_lru_size": "512", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_osd_stat_interval": "0", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crimson_seastar_cpu_cores": "", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location": "", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location_hook": "", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_location_hook_timeout": "10", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "daemonize": "false", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "daos_pool": "tank", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-06-11T15:59:17.374 INFO:teuthology.orchestra.run.smithi089.stdout: "dbstore_db_name_prefix": "dbstore", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_alienstore": "0/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_allow_any_pool_priority": "false", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asok": "1/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asok_assert_abort": "false", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_asserts_on_shutdown": "true", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_auth": "20/20", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bdev": "1/3", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bluefs": "1/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_bluestore": "1/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_buffer": "0/1", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_ceph_exporter": "1/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cephfs_mirror": "0/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cephsqlite": "0/5", 2024-06-11T15:59:17.375 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_client": "0/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_compressor": "1/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_context": "0/1", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crimson_interrupt": "0/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crush": "1/1", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_crypto": "1/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_cyanstore": "0/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_deliberately_leak_memory": "false", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_disable_randomized_ping": "false", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_dpdk": "1/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_eventtrace": "1/5", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_filer": "0/1", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_filestore": "1/3", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_finisher": "1/1", 2024-06-11T15:59:17.376 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_fuse": "1/5", 2024-06-11T15:59:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_heartbeat_testing_span": "0", 2024-06-11T15:59:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_heartbeatmap": "1/5", 2024-06-11T15:59:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_immutable_obj_cache": "0/5", 2024-06-11T15:59:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_javaclient": "1/5", 2024-06-11T15:59:17.377 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_journal": "1/3", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_journaler": "0/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_kstore": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_lockdep": "0/1", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mclock": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_balancer": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_locker": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_log": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_log_expire": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_migrator": "1/5", 2024-06-11T15:59:17.378 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mds_quiesce": "3/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_memstore": "1/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mgr": "2/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mgrc": "1/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_mon": "20/20", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_monc": "0/10", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_ms": "1/1", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_none": "0/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objclass": "0/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objectcacher": "0/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_objecter": "0/1", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_optracker": "0/5", 2024-06-11T15:59:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_osd": "1/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_paxos": "20/20", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_perfcounter": "1/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_prioritycache": "1/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rados": "0/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd": "0/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_mirror": "0/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_pwl": "0/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rbd_replay": "0/5", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_refs": "0/0", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_reserver": "1/1", 2024-06-11T15:59:17.380 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_access": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_datacache": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_dbstore": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_flight": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_lifecycle": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rgw_sync": "1/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_rocksdb": "4/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore": "0/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_backref": "0/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_cache": "0/5", 2024-06-11T15:59:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_cleaner": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_device": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_epm": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_journal": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_lba": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_odata": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_omap": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_onode": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_t": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_seastore_tm": "0/5", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_striper": "0/1", 2024-06-11T15:59:17.382 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_test": "0/5", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_throttle": "1/1", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_timer": "0/1", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_tp": "0/5", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "debug_trace": "1/5", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "device_failure_prediction_mode": "none", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_graylog": "false", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_journald": "false", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_stderr": "true", 2024-06-11T15:59:17.383 INFO:teuthology.orchestra.run.smithi089.stdout: "err_to_syslog": "false", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "event_tracing": "false", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_addr": "0.0.0.0", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_http_port": "9926", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_prio_limit": "5", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_sort_metrics": "true", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "exporter_stats_period": "5", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "fake_statfs_for_testing": "0", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "fatal_signal_handlers": "true", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "filer_max_purge_ops": "10", 2024-06-11T15:59:17.384 INFO:teuthology.orchestra.run.smithi089.stdout: "filer_max_truncate_ops": "128", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_apply_finisher_threads": "1", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_blackhole": "false", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_btrfs_clone_range": "true", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_btrfs_snap": "true", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_caller_concurrency": "10", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_collect_device_partition_information": "true", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_commit_timeout": "600.000000", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_inject_read_err": "false", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_omap_check": "false", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_random_read_err": "0.000000", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_debug_verify_split": "false", 2024-06-11T15:59:17.385 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_dump_file": "", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fadvise": "true", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fail_eio": "true", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fd_cache_shards": "16", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fd_cache_size": "128", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fiemap": "false", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fiemap_threshold": "4096", 2024-06-11T15:59:17.386 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_index_retry_probability": "0.000000", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_inject_stall": "0", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_parallel": "false", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_trailing": "false", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_journal_writeahead": "false", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_kill_at": "0", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-06-11T15:59:17.387 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size": "0", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs": "0", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_other": "2", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_sync_interval": "5.000000", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size": "0", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-06-11T15:59:17.388 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_merge_threshold": "-10", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_min_sync_interval": "0.010000", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_odsync_write": "false", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_backend": "rocksdb", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_backend_path": "", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_omap_header_cache_size": "1024", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_ondisk_finisher_threads": "1", 2024-06-11T15:59:17.389 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_thread_timeout": "60", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_op_threads": "2", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_punch_hole": "false", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_bytes": "104857600", 2024-06-11T15:59:17.390 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_queue_max_ops": "50", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_seek_data_hole": "false", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_sloppy_crc": "false", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_splice": "false", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_split_multiple": "2", 2024-06-11T15:59:17.391 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_split_rand_factor": "20", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_update_to": "1000", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_enable": "true", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-06-11T15:59:17.392 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_xfs_extsize": "false", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "filestore_zfs_snap": "false", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "fio_dir": "/tmp/fio", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_allow_other": "true", 2024-06-11T15:59:17.393 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_atomic_o_trunc": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_big_writes": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_debug": "false", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_default_permissions": "false", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_disable_pagecache": "false", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_max_write": "0", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_multithreaded": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_require_active_mds": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_set_user_groups": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_move": "true", 2024-06-11T15:59:17.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_read": "true", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_splice_write": "true", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_syncfs_on_mksnap": "true", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "fuse_use_invalidate_cb": "true", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "gss_target_name": "ceph", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_file": "", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_inject_failure": "0", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_interval": "5", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "host": "smithi089", 2024-06-11T15:59:17.395 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_max_size": "1073741824", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "immutable_object_cache_watermark": "0.900000", 2024-06-11T15:59:17.396 INFO:teuthology.orchestra.run.smithi089.stdout: "inject_early_sigterm": "false", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "jaeger_agent_port": "6799", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "jaeger_tracing_enable": "false", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_aio": "true", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_align_min_size": "65536", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_block_align": "true", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_block_size": "4096", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_dio": "true", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_discard": "false", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_force_aio": "false", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_ignore_corruption": "false", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_max_write_bytes": "10485760", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_max_write_entries": "100", 2024-06-11T15:59:17.397 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_replay_from": "0", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_high_multiple": "0.000000", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_throttle_max_multiple": "0.000000", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_write_header_frequency": "0", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journal_zero_on_create": "false", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_prefetch_periods": "10", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_prezero_periods": "5", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "journaler_write_head_interval": "15", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "key": "", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "keyfile": "", 2024-06-11T15:59:17.398 INFO:teuthology.orchestra.run.smithi089.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_backend": "rocksdb", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_default_stripe_size": "65536", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_fsck_on_mount": "false", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_fsck_on_mount_deep": "true", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_max_bytes": "67108864", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_max_ops": "512", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_nid_prealloc": "1024", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_onode_map_size": "1024", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_sync_submit_transaction": "false", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "kstore_sync_transaction": "false", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "librados_thread_count": "2", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "lockdep": "false", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "lockdep_force_backtrace": "false", 2024-06-11T15:59:17.399 INFO:teuthology.orchestra.run.smithi089.stdout: "log_coarse_timestamps": "true", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_flush_on_exit": "false", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_graylog_host": "127.0.0.1", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_graylog_port": "12201", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_max_new": "1000", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_max_recent": "10000", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_stderr_prefix": "", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_stop_at_utilization": "0.970000", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_file": "true", 2024-06-11T15:59:17.400 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_graylog": "false", 2024-06-11T15:59:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_journald": "false", 2024-06-11T15:59:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_stderr": "false", 2024-06-11T15:59:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "log_to_syslog": "false", 2024-06-11T15:59:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "max_rotating_auth_attempts": "10", 2024-06-11T15:59:17.401 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_action_on_write_error": "1", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_alternate_name_max": "8192", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_asio_thread_count": "2", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_export_pin": "true", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_dirs": "true", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_interval": "5", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_fragment_size_max": "100000", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_idle_threshold": "0.000000", 2024-06-11T15:59:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_interval": "10", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_max": "-1", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_max_until": "-1", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_merge_size": "50", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_midchunk": "0.300000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_min_rebalance": "0.100000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_min_start": "0.200000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_minchunk": "0.001000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_mode": "0", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_need_max": "1.200000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_need_min": "0.800000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_overload_epochs": "2", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_sample_interval": "3.000000", 2024-06-11T15:59:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_bits": "3", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_rd": "25000.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_size": "10000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_split_wr": "10000.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_target_decay": "10.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_grace": "15.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_interval": "4.000000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_beacon_mon_down_grace": "60", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_memory_limit": "4294967296", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_mid": "0.700000", 2024-06-11T15:59:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_delay": "0", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_sleep": "200", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_splitauth": "true", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_quiesce_threshold": "524288", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_release_free_interval": "10", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_reservation": "0.050000", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_interval": "1", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cache_trim_threshold": "262144", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_delegate_inos_pct": "50", 2024-06-11T15:59:17.405 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_prealloc_inos": "1000", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_connect_bootstrapping": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_damage_table_max_entries": "10000", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_auth_pins": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_frag": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_scatterstat": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_debug_subtrees": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_decay_halflife": "5.000000", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_default_dir_hash": "2", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_defer_session_stale": "true", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_deny_all_reconnect": "false", 2024-06-11T15:59:17.406 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_keys_per_op": "16384", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_max_commit_size": "10", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_max_entries": "0", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dir_prefetch": "true", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dirstat_min_interval": "1.000000", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_after_rejoin": "false", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_on_map": "false", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_threshold_file": "0", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_early_reply": "true", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_enable_op_tracker": "true", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_enforce_unique_name": "true", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_distributed": "true", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-06-11T15:59:17.407 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_random": "true", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_forward_all_requests_to_auth": "false", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_health_cache_threshold": "1.500000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_health_summarize_threshold": "10", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_heartbeat_grace": "15.000000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_heartbeat_reset_grace": "1000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_health_dummy": "false", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-06-11T15:59:17.408 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_migrator_session_race": "false", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_join_fs": "", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_journal_format": "1", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_create_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_export_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_import_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_expire_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_journal_replay_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_link_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_mdstable_at": "0", 2024-06-11T15:59:17.409 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_openc_at": "0", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_rename_at": "0", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_shutdown_at": "0", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_event_large_threshold": "524288", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_events_per_segment": "1024", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_major_segment_event_ratio": "12", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_max_events": "-1", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_max_segments": "128", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_pause": "false", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_segment_size": "0", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_skip_corrupt_events": "false", 2024-06-11T15:59:17.410 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_skip_unbounded_events": "false", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_threshold": "128", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_log_warn_factor": "2.000000", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_caps_per_client": "1048576", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_completed_flushes": "100000", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_completed_requests": "100000", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_export_size": "20971520", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_file_recover": "32", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_files": "64", 2024-06-11T15:59:17.411 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_ops": "8192", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_max_snaps_per_dir": "100", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_metrics_update_interval": "2", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_min_caps_per_client": "100", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_min_caps_working_set": "10000", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_numa_node": "-1", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_complaint_time": "30.000000", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_duration": "600", 2024-06-11T15:59:17.412 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_size": "20", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_slow_op_size": "20", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_history_slow_op_threshold": "10", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_op_log_threshold": "5", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_ping_grace": "15", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_ping_interval": "5", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_caps": "30000", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_max_decay_threshold": "131072", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_recall_warning_threshold": "262144", 2024-06-11T15:59:17.413 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_reconnect_timeout": "45.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_replay_interval": "1.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_root_ino_gid": "0", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_root_ino_uid": "0", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_blocklist_on_evict": "true", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_blocklist_on_timeout": "true", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-06-11T15:59:17.414 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_session_metadata_threshold": "16777216", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_shutdown_check": "0", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_skip_ino": "0", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_sleep_rank_change": "0.000000", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_max_uid": "4294967294", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_min_uid": "0", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_snap_rstat": "false", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_standby_replay_damaged": "false", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_symlink_recovery": "true", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_task_status_update_interval": "2.000000", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_thrash_exports": "0", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_thrash_fragments": "0", 2024-06-11T15:59:17.415 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_tick_interval": "5.000000", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_valgrind_exit": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_verify_backtrace": "1", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_verify_scatter": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_wipe_ino_prealloc": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_wipe_sessions": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mempool_debug": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_debug_omit_block_device_write": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_device_bytes": "1073741824", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_page_set": "false", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "memstore_page_size": "65536", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_bytes": "134217728", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_messages": "512", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-06-11T15:59:17.416 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_connect_retry_interval": "1.000000", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_disabled_modules": "", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_max_pg_num_change": "128", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mds_bytes": "134217728", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mds_messages": "128", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mon_bytes": "134217728", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_mon_messages": "128", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_osd_bytes": "536870912", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_osd_messages": "8192", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_pool": "true", 2024-06-11T15:59:17.417 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_service_beacon_grace": "60.000000", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_standby_modules": "true", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_stats_period": "5", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_stats_threshold": "5", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_tick_period": "2", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_accept_timeout_factor": "2.000000", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_allow_pool_delete": "true", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_allow_pool_size_one": "true", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_auth_validate_all_caps": "true", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_bytes": "104857600", 2024-06-11T15:59:17.418 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_directed_command_retry": "2", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval": "3.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_hunt_parallel": "3", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_log_interval": "1.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_ping_interval": "10.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_ping_timeout": "30.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_client_target_rank": "-1", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clock_drift_allowed": "1.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-06-11T15:59:17.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_file_level": "debug", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_file": "true", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog": "false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_journald": "false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_stderr": "false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_bootstrap": "false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_start": "false", 2024-06-11T15:59:17.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_compact_on_trim": "true", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_con_tracker_persist_interval": "10", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_con_tracker_score_halflife": "43200", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_config_key_max_entry_size": "65536", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_cpu_threads": "4", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_crush_min_required_version": "hammer", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_daemon_bytes": "419430400", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-06-11T15:59:17.421 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_avail_crit": "5", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_avail_warn": "5", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_data_size_warn": "16106127360", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_block_osdmap_trim": "false", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_json": "false", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-06-11T15:59:17.422 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_dump_transactions": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_extra_checks": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_reef": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_no_require_squid": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-06-11T15:59:17.423 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_delta_reset_interval": "10.000000", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_dns_srv_name": "ceph-mon", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_down_mkfs_grace": "120", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_down_uptime_grace": "60", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_election_default_strategy": "1", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_election_timeout": "5.000000", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ping_divisor": "2", 2024-06-11T15:59:17.424 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_elector_ping_timeout": "2.000000", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_enable_op_tracker": "true", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_fake_pool_delete": "false", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_force_quorum_join": "false", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_globalid_prealloc": "10000", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_detail_to_clog": "false", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_log_update_period": "5", 2024-06-11T15:59:17.425 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_max_detail": "50", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog": "true", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog_interval": "600", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_host": "172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790],[v2:172.21.15.89:3302,v1:172.21.15.89:6791]", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_host_override": "", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_initial_members": "", 2024-06-11T15:59:17.426 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_keyvaluedb": "rocksdb", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease": "5.000000", 2024-06-11T15:59:17.427 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_full_interval": "50", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_max": "10000", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_log_max_summary": "50", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_log_entries_per_event": "4096", 2024-06-11T15:59:17.428 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_log_epochs": "500", 2024-06-11T15:59:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_mdsmap_epochs": "500", 2024-06-11T15:59:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_mgrmap_epochs": "500", 2024-06-11T15:59:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_osd": "10000", 2024-06-11T15:59:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_pg_per_osd": "10000", 2024-06-11T15:59:17.429 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_pool_pg_num": "65536", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_force_trim_to": "0", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mds_skip_sanity": "false", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_memory_autotune": "true", 2024-06-11T15:59:17.430 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_memory_target": "2147483648", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_beacon_grace": "30", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_digest_period": "5", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_inactive_grace": "60", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_mkfs_grace": "240", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-06-11T15:59:17.431 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_min_osdmap_epochs": "500", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_complaint_time": "30", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_duration": "600", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_size": "20", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_slow_op_size": "20", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_history_slow_op_threshold": "10", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_op_log_threshold": "5", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-06-11T15:59:17.432 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_in": "false", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_auto_mark_new_in": "true", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_cache_size": "500", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_cache_size_min": "134217728", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_crush_smoke_test": "true", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_destroyed_out_interval": "600", 2024-06-11T15:59:17.433 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_down_out_interval": "600", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_force_trim_to": "0", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_full_ratio": "0.950000", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_halflife": "3600", 2024-06-11T15:59:17.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_max_interval": "300", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_laggy_weight": "0.300000", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_max_creating_pgs": "1024", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_max_initial_pgs": "1024", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_down_reporters": "2", 2024-06-11T15:59:17.435 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp": "true", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_report_timeout": "900", 2024-06-11T15:59:17.436 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_warn_num_repaired": "10", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osd_warn_op_age": "32.000000", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_interval": "10", 2024-06-11T15:59:17.437 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_min": "10000", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_stuck_threshold": "60", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_objects": "10000", 2024-06-11T15:59:17.438 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_per_osd": "0", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pool_quota_crit_threshold": "0", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_pool_quota_warn_threshold": "0", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_probe_timeout": "2.000000", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_max_change": "0.050000", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_max_osds": "4", 2024-06-11T15:59:17.439 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_interval": "86400", 2024-06-11T15:59:17.440 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_max_keys": "100", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_scrub_timeout": "300", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_session_timeout": "300", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_smart_report_timeout": "5", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stat_smooth_intervals": "6", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-06-11T15:59:17.441 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_pool_min_size": "2", 2024-06-11T15:59:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_pool_size": "4", 2024-06-11T15:59:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-06-11T15:59:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_subscribe_interval": "86400.000000", 2024-06-11T15:59:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_debug": "false", 2024-06-11T15:59:17.442 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_max_payload_keys": "2000", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_max_payload_size": "1048576", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_provider_kill_at": "0", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_requester_kill_at": "0", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_sync_timeout": "60.000000", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_target_pg_per_osd": "100", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_tick_interval": "5", 2024-06-11T15:59:17.443 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_timecheck_interval": "300.000000", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_use_min_delay_socket": "false", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_older_version_delay": "604800", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-06-11T15:59:17.444 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_filestore_osds": "false", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_misplaced": "false", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_older_version": "true", 2024-06-11T15:59:17.445 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_no_app": "true", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_on_too_few_osds": "false", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "monmap": "", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-06-11T15:59:17.446 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "motr_tracing_enabled": "false", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_op_threads": "3", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_buffer_size": "131072", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_cm": "false", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_device_name": "", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_dscp": "96", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_gid_idx": "0", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_local_gid": "", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_polling_us": "1000", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_port_num": "1", 2024-06-11T15:59:17.447 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_roce_ver": "1", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_send_buffers": "1024", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_sl": "3", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_support_srq": "true", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_rdma_type": "ib", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_async_reap_threshold": "5", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_before_connect": "false", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_ipv4": "true", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_ipv6": "false", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_msgr1": "true", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_msgr2": "true", 2024-06-11T15:59:17.448 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_port_max": "7568", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_port_min": "6800", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_prefer_ipv4": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_retry_count": "3", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_bind_retry_delay": "5", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_client": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mds": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mgr": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_mon": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_blackhole_osd": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_client_mode": "crc secure", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_cluster_mode": "crc secure", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_cluster_type": "", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_compress_secure": "false", 2024-06-11T15:59:17.449 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_connection_idle_timeout": "900", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_connection_ready_timeout": "10", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_crc_data": "true", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_crc_header": "true", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_bad_msg": "false", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_bug": "true", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_old_message": "true", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_skipped_message": "false", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_die_on_unhandled_msg": "false", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_coremask": "0xF", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-06-11T15:59:17.450 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_devs_allowlist": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_enable_tso": "true", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hugepages": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hw_flow_control": "true", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_lro": "true", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_memory_channel": "4", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_pmd": "", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_port_id": "0", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-06-11T15:59:17.451 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dump_corrupt_message_level": "1", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_dump_on_send": "false", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_initial_backoff": "0.200000", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_max": "1.000000", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_probability": "0.000000", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_delay_type": "", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_internal_delays": "0.000000", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_network_congestion": "0", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_inject_socket_failures": "0", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_learn_addr_from_peer": "true", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_max_accept_failures": "4", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_max_backoff": "15.000000", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_client_mode": "secure crc", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_cluster_mode": "secure crc", 2024-06-11T15:59:17.452 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_mon_service_mode": "secure crc", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compress_min_size": "1024", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compress_mode": "none", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_osd_compression_algorithm": "snappy", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_pq_min_cost": "65536", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_public_type": "", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_service_mode": "crc secure", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_listen_backlog": "512", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_nodelay": "true", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_tcp_rcvbuf": "0", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "ms_type": "async+posix", 2024-06-11T15:59:17.453 INFO:teuthology.orchestra.run.smithi089.stdout: "no_config_file": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_completion_locks_per_session": "32", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_debug_inject_relock_delay": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inflight_op_bytes": "104857600", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inflight_ops": "1024", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_inject_no_watch_ping": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_tick_interval": "5.000000", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objecter_timeout": "10.000000", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objectstore_blackhole": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "openssl_engine_opts": "", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_delay_time": "5.000000", 2024-06-11T15:59:17.454 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_hist_halflife": "1000", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_max_low_ops": "2", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_max_ops": "4", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_quantize_effort": "0.100000", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_agent_slop": "0.020000", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_allow_recovery_below_min_size": "true", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_asio_thread_count": "2", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_async_recovery_min_cost": "100", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_auto_mark_unfound_lost": "false", 2024-06-11T15:59:17.455 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_retry_interval": "30.000000", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_scan_max": "512", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backfill_scan_min": "64", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_degraded": "false", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_peering": "false", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_backoff_on_unfound": "true", 2024-06-11T15:59:17.456 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_beacon_report_interval": "300", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_duration": "30", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_max_block_size": "67108864", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_bench_small_size_max_iops": "100", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_blkin_trace_all": "false", 2024-06-11T15:59:17.457 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_blocked_scrub_grace_period": "120", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_check_for_log_corruption": "false", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-06-11T15:59:17.458 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_class_update_on_start": "true", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_message_cap": "256", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_message_size_cap": "524288000", 2024-06-11T15:59:17.459 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_op_priority": "63", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_client_watch_timeout": "30", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_command_max_records": "256", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_compact_on_start": "false", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_chooseleaf_type": "0", 2024-06-11T15:59:17.460 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_initial_weight": "-1.000000", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_update_on_start": "true", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_crush_update_weight_set": "true", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_drop_ping_duration": "0", 2024-06-11T15:59:17.461 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_feed_pullee": "-1", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_misdirected_ops": "false", 2024-06-11T15:59:17.462 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_no_acting_change": "false", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_no_purge_strays": "false", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_op_order": "false", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_pg_log_writeout": "false", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_pretend_recovery_active": "false", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-06-11T15:59:17.463 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_shutdown": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_trim_objects": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_cached_snaps": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_missing_on_start": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_snaps": "false", 2024-06-11T15:59:17.464 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_keys": "1024", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-06-11T15:59:17.465 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_stride": "524288", 2024-06-11T15:59:17.466 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-06-11T15:59:17.466 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_default_data_pool_replay_window": "5", 2024-06-11T15:59:17.466 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_default_notify_timeout": "30", 2024-06-11T15:59:17.466 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep": "0.000000", 2024-06-11T15:59:17.466 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_discard_disconnected_ops": "true", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_enable_op_tracker": "true", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_extblkdev_plugins": "vdo", 2024-06-11T15:59:17.467 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_info": "true", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown": "true", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_fast_shutdown_timeout": "15", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-06-11T15:59:17.468 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_function_tracing": "false", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_grace": "20", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_interval": "6", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_peers": "10", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_min_size": "2000", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_stale": "600", 2024-06-11T15:59:17.469 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_max_size": "100000", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_min_size": "1000", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-06-11T15:59:17.470 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal_flush_on_shutdown": "true", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_journal_size": "5120", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_kill_backfill_at": "0", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_loop_before_reset_tphandle": "64", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_cache_size": "50", 2024-06-11T15:59:17.471 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_dedup": "true", 2024-06-11T15:59:17.472 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_message_max": "40", 2024-06-11T15:59:17.472 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_message_max_bytes": "10485760", 2024-06-11T15:59:17.472 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_map_share_max_epochs": "40", 2024-06-11T15:59:17.472 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_attr_name_len": "100", 2024-06-11T15:59:17.472 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_attr_size": "0", 2024-06-11T15:59:17.473 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_backfills": "1", 2024-06-11T15:59:17.473 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_markdown_count": "5", 2024-06-11T15:59:17.473 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_markdown_period": "600", 2024-06-11T15:59:17.473 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_name_len": "2048", 2024-06-11T15:59:17.473 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_namespace_len": "256", 2024-06-11T15:59:17.474 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_object_size": "134217728", 2024-06-11T15:59:17.474 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-06-11T15:59:17.474 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_omap_entries_per_request": "1024", 2024-06-11T15:59:17.474 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_blocked_by": "16", 2024-06-11T15:59:17.474 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_log_entries": "10000", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_pgls": "1024", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_push_cost": "8388608", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_push_objects": "10", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_scrubs": "3", 2024-06-11T15:59:17.475 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_trimming_pgs": "2", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_write_op_reply_len": "64", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_max_write_size": "90", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-06-11T15:59:17.476 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_override_recovery_settings": "false", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_profile": "balanced", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-06-11T15:59:17.477 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-06-11T15:59:17.478 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mclock_skip_benchmark": "false", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_base": "805306368", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_cache_min": "134217728", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target": "4294967296", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target_autotune": "false", 2024-06-11T15:59:17.479 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_min_pg_log_entries": "250", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_min_recovery_priority": "0", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_heartbeat_interval": "30", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_report_interval": "5", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_report_max_in_flight": "2", 2024-06-11T15:59:17.480 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_num_cache_shards": "32", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_num_op_tracker_shard": "32", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_auto_affinity": "true", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_node": "-1", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_numa_prefer_iface": "true", 2024-06-11T15:59:17.481 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objecter_finishers": "1", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore": "bluestore", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore_fuse": "false", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_objectstore_tracing": "false", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_complaint_time": "30.000000", 2024-06-11T15:59:17.482 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_duration": "600", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_size": "20", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_slow_op_size": "20", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_log_threshold": "5", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards": "0", 2024-06-11T15:59:17.483 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards_hdd": "5", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_shards_ssd": "8", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard": "0", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-06-11T15:59:17.484 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_pq_min_cost": "65536", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_queue": "mclock_scheduler", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_queue_cut_off": "high", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_thread_suicide_timeout": "150", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_op_thread_timeout": "15", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_open_classes_on_start": "true", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_os_flags": "0", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_peering_op_priority": "255", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_delete_cost": "1048576", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_delete_priority": "5", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_dups_tracked": "3000", 2024-06-11T15:59:17.485 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_trim_max": "10000", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_log_trim_min": "100", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_object_context_cache_count": "64", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_crimson": "false", 2024-06-11T15:59:17.486 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_crush_rule": "-1", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_ec_fast_read": "false", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_bulk": "false", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nodelete": "false", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_flags": "0", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_min_size": "0", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-06-11T15:59:17.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pg_num": "32", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_pgp_num": "0", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_read_ratio": "70", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_size": "2", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_default_type": "replicated", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_pool_use_gmt_hitset": "true", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_push_per_object_cost": "1000", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_read_ec_check_for_errors": "false", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recover_clone_overlap": "true", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recover_clone_overlap_limit": "10", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_cost": "20971520", 2024-06-11T15:59:17.488 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_delay_start": "0.000000", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active": "0", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active_hdd": "3", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_active_ssd": "10", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_chunk": "8388608", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_max_single_start": "1", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_op_priority": "3", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_op_warn_multiple": "16", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_priority": "5", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_retry_interval": "30.000000", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep": "0.000000", 2024-06-11T15:59:17.489 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_repair_during_recovery": "false", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_requested_scrub_priority": "120", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_rollback_to_cluster_snap": "", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_auto_repair": "false", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_begin_hour": "0", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_begin_week_day": "0", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_chunk_max": "25", 2024-06-11T15:59:17.490 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_chunk_min": "5", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_cost": "52428800", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_during_recovery": "false", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_end_hour": "0", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_end_week_day": "0", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_event_cost": "4096", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_invalid_stats": "true", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_load_threshold": "0.500000", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_max_interval": "604800.000000", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_max_preemptions": "5", 2024-06-11T15:59:17.491 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_min_interval": "86400.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_priority": "5", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_scrub_sleep": "0.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_shutdown_pgref_assert": "false", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_skip_data_digest": "false", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_smart_report_timeout": "5", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_cost": "1048576", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_priority": "5", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep": "0.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-06-11T15:59:17.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_stats_update_period_scrubbing": "15", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_target_transaction_size": "30", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_default_cache_mode": "writeback", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-06-11T15:59:17.493 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_tracing": "false", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_use_stale_snap": "false", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "osdc_blkin_trace_all": "false", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_kill_at": "0", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_max_join_drift": "10", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_min": "500", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_min_wait": "0.050000", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_propose_interval": "1.000000", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_max": "500", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_max_multiplier": "20", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_service_trim_min": "250", 2024-06-11T15:59:17.494 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_stash_full_interval": "25", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_trim_max": "500", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "paxos_trim_min": "250", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "perf": "true", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-06-11T15:59:17.495 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "-", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrv": "", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "public_bind_addr": "-", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "public_network": "", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "public_network_interface": "", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "qat_compressor_enabled": "false", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "qat_compressor_session_max_number": "256", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_mon_op_timeout": "0", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_osd_op_timeout": "0", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rados_tracing": "false", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_atime_update_interval": "60", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_balance_parent_reads": "false", 2024-06-11T15:59:17.496 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_balance_snap_reads": "false", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blkin_trace_all": "false", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blocklist_expire_seconds": "0", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_blocklist_on_break_lock": "true", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache": "true", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_block_writes_upfront": "false", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty": "25165824", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_max_dirty_object": "0", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_policy": "writearound", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_size": "33554432", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_target_dirty": "16777216", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-06-11T15:59:17.497 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_clone_copy_on_read": "false", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_compression_hint": "none", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_concurrent_management_ops": "10", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_clone_format": "auto", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_data_pool": "", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_features": "61", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_format": "2", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_map_options": "", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_order": "22", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_pool": "rbd", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-06-11T15:59:17.498 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_stripe_count": "0", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_default_stripe_unit": "0", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_disable_zero_copy_writes": "true", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_discard_granularity_bytes": "65536", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_enable_alloc_hint": "true", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_io_scheduler": "simple", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_commit_age": "5.000000", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-06-11T15:59:17.499 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_flush_interval": "0", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_order": "24", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_pool": "", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_journal_splay_width": "4", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_localize_parent_reads": "false", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_localize_snap_reads": "false", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-06-11T15:59:17.500 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_type": "simple", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_autotune": "true", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_base": "805306368", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-06-11T15:59:17.501 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_memory_target": "4294967296", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_delete_delay": "0", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_replay_delay": "0", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_to_trash_on_remove": "false", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_mtime_update_interval": "60", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_non_blocking_aio": "true", 2024-06-11T15:59:17.502 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_op_thread_timeout": "60", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_op_threads": "1", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_parent_cache_enabled": "false", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_mode": "disabled", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_path": "/tmp", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_persistent_cache_size": "1073741824", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_plugins": "", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_burst": "0", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_bps_limit": "0", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_exclude_ops": "0", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_burst": "0", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-06-11T15:59:17.503 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_iops_limit": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_burst": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_bps_limit": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_burst": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_read_iops_limit": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_schedule_tick_min": "50", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_burst": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_bps_limit": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_burst": "0", 2024-06-11T15:59:17.504 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_qos_write_iops_limit": "0", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_quiesce_notification_attempts": "10", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_read_from_replica_policy": "default", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_max_bytes": "524288", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_readahead_trigger_requests": "10", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_request_timed_out_seconds": "30", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_skip_partial_discard": "true", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_tracing": "false", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_validate_names": "true", 2024-06-11T15:59:17.505 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd_validate_pool": "true", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "restapi_base_url": "", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "restapi_log_level": "", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_account_default_quota_max_size": "-1", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_acl_grants_max_num": "100", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_admin_entry": "admin", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-06-11T15:59:17.506 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_backend_store": "rados", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_barbican_url": "", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_beast_enable_async": "true", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_counters_cache": "false", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_index_max_aio": "128", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_quota_ttl": "600", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_enabled": "true", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_expiry_interval": "900", 2024-06-11T15:59:17.507 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cache_lru_size": "25000", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_config_store": "rados", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_content_length_compat": "false", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_copy_obj_progress": "true", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cors_rules_max_num": "100", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_cross_domain_policy": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_default_encryption_key": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_addr": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_ca_path": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_client_cert": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_client_key": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_password": "", 2024-06-11T15:59:17.508 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_kmip_username": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_require_ssl": "true", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-06-11T15:59:17.509 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_suppress_logs": "true", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_addr": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_auth": "token", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_namespace": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_prefix": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-06-11T15:59:17.510 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_token_file": "", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_buffersize": "524288", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_low_speed_limit": "1024", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_low_speed_time": "300", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_tcp_keepalive": "0", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-06-11T15:59:17.511 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_fadvise": "4", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_host": "127.0.0.1", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_d4n_port": "6379", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_changes_size": "1000", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_num_shards": "128", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_log_window": "30", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_notify_interval_msec": "0", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_sync_poll_interval": "20", 2024-06-11T15:59:17.512 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_data_sync_spawn_window": "20", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_data_log_backing": "fifo", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_region_info_oid": "default.region", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_defer_to_bucket_acls": "", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-06-11T15:59:17.513 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_res": "500.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dns_name": "", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dns_s3website_name": "", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_dynamic_resharding": "true", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-06-11T15:59:17.514 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_gc_threads": "true", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_lc_threads": "true", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_ops_log": "false", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_quota_threads": "true", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_static_website": "false", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enable_usage_log": "false", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_enforce_swift_acls": "true", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_exit_timeout_secs": "120", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_expose_bucket": "false", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_extended_http_attrs": "", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_filter": "none", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_frontends": "beast port=7480", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_concurrent_io": "10", 2024-06-11T15:59:17.515 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_deferred": "50", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_objs": "32", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_queue_size": "134213632", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_max_trim_chunk": "16", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_obj_min_wait": "7200", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_processor_max_time": "3600", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_gc_processor_period": "3600", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_get_obj_window_size": "16777216", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_healthcheck_disabling_path": "", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ignore_get_invalid_range": "false", 2024-06-11T15:59:17.516 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_init_timeout": "300", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_connection_idle": "300", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_message_timeout": "5000", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_kafka_sleep_timeout": "10", 2024-06-11T15:59:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_domain": "", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_password": "", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_password_path": "", 2024-06-11T15:59:17.518 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_project": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_tenant": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_token": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_token_path": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_admin_user": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_api_version": "2", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_domain": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_password": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_project": "", 2024-06-11T15:59:17.519 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_tenant": "", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_barbican_user": "", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_implicit_tenants": "false", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_service_token_enabled": "false", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_token_cache_size": "10000", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_url": "", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_keystone_verify_ssl": "true", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_debug_interval": "-1", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_lock_max_time": "90", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_objs": "32", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_rules": "1000", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_worker": "3", 2024-06-11T15:59:17.520 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_max_wp_worker": "3", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lc_thread_delay": "0", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_dnattr": "uid", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_searchfilter": "", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ldap_uri": "", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_http_headers": "", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_nonexistent_bucket": "false", 2024-06-11T15:59:17.521 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_log_object_name_utc": "false", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attr_name_len": "0", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attr_size": "0", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_attrs_num_in_req": "0", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_chunk_size": "4194304", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_concurrent_requests": "1024", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_dynamic_shards": "1999", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_listing_results": "1000", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_notify_retries": "10", 2024-06-11T15:59:17.522 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_objs_per_shard": "100000", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_put_param_size": "1048576", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_put_size": "5368709120", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_max_slo_entries": "1000", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_md_log_max_shards": "64", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_md_notify_interval_msec": "200", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_meta_sync_poll_interval": "20", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_meta_sync_spawn_window": "20", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_mp_lock_max_time": "600", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multipart_min_part_size": "5242880", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-06-11T15:59:17.523 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_fhcache_size": "2017", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_lru_lanes": "5", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_max_gc": "300", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_gc_threads": "false", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_lc_threads": "false", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_quota_threads": "false", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_run_sync_thread": "false", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-06-11T15:59:17.524 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_num_async_rados_threads": "32", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_num_control_oids": "8", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_numa_node": "-1", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_obj_stripe_size": "4194304", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_chunk_size": "100", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_gc_interval": "600", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_objexp_hints_num_shards": "127", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_thread_timeout": "600", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_op_tracing": "false", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_token": "", 2024-06-11T15:59:17.525 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_url": "", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_opa_verify_ssl": "true", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_rados": "false", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_ops_log_socket_path": "", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_push_interval": "2.000000", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_push_interval_max": "30.000000", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_period_root_pool": ".rgw.root", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-06-11T15:59:17.526 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_lanes": "3", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_max_buckets": "100", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_cache_partitions": "3", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_print_continue": "true", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_print_prohibited_content_length": "false", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rados_tracing": "false", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm": "", 2024-06-11T15:59:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm_id": "", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_region": "", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_region_root_pool": ".rgw.root", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_relaxed_region_enforcement": "false", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_request_uri": "", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_batch_size": "64", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_max_aio": "128", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_num_logs": "16", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_reshard_thread_interval": "600", 2024-06-11T15:59:17.528 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_resolve_cname": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_rest_getusage_op_compat": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_run_sync_thread": "true", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_keystone": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_ldap": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_rados": "true", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_auth_use_sts": "false", 2024-06-11T15:59:17.529 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_s3_success_create_obj_status": "0", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_scheduler_type": "throttler", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_script_uri": "", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_service_provider_name": "", 2024-06-11T15:59:17.530 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_client_id": "", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_client_secret": "", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_entry": "sts", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_key": "sts", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_max_session_duration": "43200", 2024-06-11T15:59:17.531 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_min_session_duration": "900", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sts_token_introspection_url": "", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_account_in_url": "false", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_auth_entry": "auth", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_auth_url": "", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_custom_header": "", 2024-06-11T15:59:17.532 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_enforce_content_length": "false", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_need_stats": "true", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_tenant_name": "", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_token_expiration": "86400", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_url": "", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_url_prefix": "swift", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_swift_versioning_enabled": "false", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-06-11T15:59:17.533 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_lease_period": "120", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_interval": "1200", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-06-11T15:59:17.534 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_obj_etag_verify": "false", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_history_size": "4096", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_thread_pool_size": "512", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_max_retries": "0", 2024-06-11T15:59:17.535 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_topic_require_publish_policy": "false", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_comment": "", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_createby": "", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_encoding": "", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_flag": "false", 2024-06-11T15:59:17.536 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_max_size": "5368709120", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_origin": "", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_sha_unit": "524288", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_torrent_tracker": "", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_trust_forwarded_https": "false", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-06-11T15:59:17.537 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_log_tick_interval": "30", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_max_shards": "32", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_usage_max_user_shards": "1", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_use_opa_authz": "false", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_counters_cache": "false", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_counters_cache_size": "10000", 2024-06-11T15:59:17.538 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_default_quota_max_size": "-1", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_max_buckets": "1000", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_policies_max_num": "100", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_interval": "86400", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-06-11T15:59:17.539 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_user_unique_email": "true", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_verify_ssl": "true", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_website_routing_rules_max_num": "50", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone": "", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone_id": "", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup": "", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup_id": "", 2024-06-11T15:59:17.540 INFO:teuthology.orchestra.run.smithi089.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rgwlc_auto_session_clear": "true", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rgwlc_skip_bucket_step": "false", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_block_size": "4096", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-06-11T15:59:17.541 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_shard_bits": "4", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_size": "536870912", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cache_type": "binned_lru", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-06-11T15:59:17.542 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_compaction_stats": "false", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_extended_stats": "false", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_collect_memory_stats": "false", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_index_type": "binary_search", 2024-06-11T15:59:17.543 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_log_to_ceph_log": "true", 2024-06-11T15:59:17.544 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_metadata_block_size": "4096", 2024-06-11T15:59:17.544 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_partition_filters": "false", 2024-06-11T15:59:17.544 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_perf": "false", 2024-06-11T15:59:17.544 INFO:teuthology.orchestra.run.smithi089.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-06-11T15:59:17.544 INFO:teuthology.orchestra.run.smithi089.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "rotating_keys_renewal_timeout": "10", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "run_dir": "/var/run/ceph", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_block_create": "true", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_cache_lru_size": "67108864", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_cbjournal_size": "5368709120", 2024-06-11T15:59:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_data_delta_based_overwrite": "0", 2024-06-11T15:59:17.546 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_default_max_object_size": "16777216", 2024-06-11T15:59:17.546 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-06-11T15:59:17.546 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_device_size": "53687091200", 2024-06-11T15:59:17.546 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_full_integrity_check": "false", 2024-06-11T15:59:17.546 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_capacity": "16", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_journal_iodepth_limit": "5", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_main_device_type": "SSD", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_max_concurrent_transactions": "8", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_max_data_allocation_size": "32768", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-06-11T15:59:17.547 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "seastore_segment_size": "67108864", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "set_keepcaps": "false", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "setgroup": "", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "setuser": "", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "setuser_match_path": "", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_misplaced_ratio": "0.050000", 2024-06-11T15:59:17.548 INFO:teuthology.orchestra.run.smithi089.stdout: "thp": "false", 2024-06-11T15:59:17.549 INFO:teuthology.orchestra.run.smithi089.stdout: "threadpool_default_timeout": "60", 2024-06-11T15:59:17.549 INFO:teuthology.orchestra.run.smithi089.stdout: "threadpool_empty_queue_max_wait": "2", 2024-06-11T15:59:17.549 INFO:teuthology.orchestra.run.smithi089.stdout: "throttler_perf_counter": "true" 2024-06-11T15:59:17.549 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T15:59:17.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-06-11T15:59:17.666 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a: {} 2024-06-11T15:59:17.666 INFO:teuthology.orchestra.run.smithi089.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T15:59:17.674 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b: {} 2024-06-11T15:59:17.675 INFO:teuthology.orchestra.run.smithi089.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T15:59:17.683 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c: {} 2024-06-11T15:59:17.683 INFO:teuthology.orchestra.run.smithi089.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T15:59:17.694 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-06-11T15:59:17.694 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-11T15:59:17.725 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-11T15:59:17.725 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-06-11T15:59:17.726 INFO:tasks.ceph_fuse:client.0 config is {} 2024-06-11T15:59:17.726 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-11T15:59:17.726 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:17.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:17.726 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-06-11T15:59:17.727 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-06-11T15:59:17.727 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-06-11T15:59:17.728 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-06-11T15:59:17.728 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-06-11T15:59:17.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:17.729 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-06-11T15:59:17.729 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:17.729 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-06-11T15:59:17.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T15:59:17.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:17.730+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:17.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:17.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-06-11T15:59:17.813 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-06-11T15:59:17.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T15:59:17.815 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-11T15:59:17.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-11T15:59:17.830 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:17.830+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:17.849 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:17.849 INFO:teuthology.orchestra.run.smithi129.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-06-11T15:59:17.849 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:17.850 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:17.850 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:17.850 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:17.850 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:17.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:17.858 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:17.860 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:17.877 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:17.877 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:17.895 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:17.896 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:17.930 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:17.931+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:17.965 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:17.965 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:17.974 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:18.031 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:18.032+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:18.079 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.079 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:18.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:18.135+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:18.181 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-11T15:59:18.194 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-11T15:59:18.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:18.195 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-06-11T15:59:18.206 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.206 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.210 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-11T15:59:18.210 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-11T15:59:18.210 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-06-11T15:59:18.210 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-11T15:59:18.211 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2024-06-11T15:59:18.212 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-06-11T15:59:18.213 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-11T15:59:18.213 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-06-11T15:59:18.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:18.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:18.257+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:18.258 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T15:59:18.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-11T15:59:18.337 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:18.337+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.361 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.370 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:18.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:18.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:18.415 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-11T15:59:18.437 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:18.438+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:18.475 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.475 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.480 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-06-11T15:59:18.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:18.482 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-06-11T15:59:18.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:18.537 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:18.538+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:18.551 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-06-11T15:59:18.551 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-11T15:59:18.551 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-11T15:59:18.551 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-11T15:59:18.551 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-11T15:59:18.552 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-06-11T15:59:18.602 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.602 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.612 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:18.638 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:18.640+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:18.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-11T15:59:18.739 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:18.740+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:18.762 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.763 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:18.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:18.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:18.840 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-06-11T15:59:18.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:18.858 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-06-11T15:59:18.858 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:18.859+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:18.917 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-11T15:59:18.918 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-06-11T15:59:18.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T15:59:18.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-11T15:59:18.918 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-06-11T15:59:18.919 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:18.919 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:18.928 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:18.978 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:18.979+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:19.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-11T15:59:19.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:19.039 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-11T15:59:19.039 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-11T15:59:19.040 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-06-11T15:59:19.048 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.048 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:19.045+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:19.053 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:19.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-11T15:59:19.143 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.144+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:19.201 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.201 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.207 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-11T15:59:19.207 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-06-11T15:59:19.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-06-11T15:59:19.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-06-11T15:59:19.207 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-06-11T15:59:19.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:19.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-11T15:59:19.257 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:19.258+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:19.278 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:19.285 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-11T15:59:19.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-11T15:59:19.285 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:19.301 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-11T15:59:19.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-11T15:59:19.301 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:19.317 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.317 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:19.344 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.345+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.361 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-06-11T15:59:19.430 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-06-11T15:59:19.445 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.445 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.446 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.447+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.454 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-06-11T15:59:19.487 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/selinux 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-06-11T15:59:19.488 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysctl.service 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/nfs/rpc_pipefs 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T15:59:19.489 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T15:59:19.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:19.490 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-06-11T15:59:19.545 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-11T15:59:19.545 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-11T15:59:19.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:19.547+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:19.564 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.564 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:19.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2024-06-11T15:59:19.616 DEBUG:teuthology.orchestra.run.smithi089:> cat /proc/self/mounts | awk '{print $2}' 2024-06-11T15:59:19.647 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.649+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:/proc 2024-06-11T15:59:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:/sys 2024-06-11T15:59:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:/dev 2024-06-11T15:59:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/security 2024-06-11T15:59:19.673 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/shm 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/pts 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/run 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/cgroup 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/pstore 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/bpf 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/ 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/selinux 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/proc/sys/fs/binfmt_misc 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/mqueue 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/dev/hugepages 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/debug 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/tracing 2024-06-11T15:59:19.674 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/fs/fuse/connections 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/sys/kernel/config 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-sysctl.service 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/nfs/rpc_pipefs 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/user/1000 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/var/lib/ceph 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run.smithi089.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T15:59:19.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:19.676 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2024-06-11T15:59:19.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:2024-06-11T15:59:19.697+0000 7f7bba3b4480 -1 init, newargv = 0x564c2311efb0 newargc=15 2024-06-11T15:59:19.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[34189]: starting ceph client 2024-06-11T15:59:19.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[34189]: starting fuse 2024-06-11T15:59:19.713 INFO:teuthology.orchestra.run.smithi089.stdout:41 2024-06-11T15:59:19.713 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-06-11T15:59:19.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2024-06-11T15:59:19.713 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> import re 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> import os 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> 2024-06-11T15:59:19.714 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-11T15:59:19.715 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> return f 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.0")) 2024-06-11T15:59:19.716 DEBUG:teuthology.orchestra.run.smithi089:> ' 2024-06-11T15:59:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.730 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:19.774 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.774+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.831 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.0.34189.asok 2024-06-11T15:59:19.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-06-11T15:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-11T15:59:19.842 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34189.asok 2024-06-11T15:59:19.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:19.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34189.asok status 2024-06-11T15:59:19.845 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:19.845 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:19.849 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.849+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.854 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:19.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:19.949 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:19.949+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:19.978 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T15:59:19.978 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2024-06-11T15:59:19.978 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "3f51ea3944d39ca13aa40153c9a4ee298306679d", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 19.0.0-2976-g3f51ea39 (3f51ea3944d39ca13aa40153c9a4ee298306679d) squid (rc)", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "0", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "34189", 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2024-06-11T15:59:19.979 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 14414, 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2024-06-11T15:59:19.980 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 14414 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 775289756 2024-06-11T15:59:19.981 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 775289756 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.14414 192.168.0.1:0/775289756", 2024-06-11T15:59:19.982 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "192.168.0.1:0/775289756", 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 5, 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 20, 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2024-06-11T15:59:19.983 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T15:59:19.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:19.987 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2024-06-11T15:59:19.987 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.001 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:20.001 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:20.002 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2024-06-11T15:59:20.003 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T15:59:20.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.010 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:20.048 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:20.049 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:20.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:20.050+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:20.068 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:20.068 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:20.069 INFO:teuthology.run_tasks:Running task workunit... 2024-06-11T15:59:20.082 INFO:tasks.workunit:Pulling workunits from ref 3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:59:20.083 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-11T15:59:20.083 INFO:tasks.workunit:timeout=6h 2024-06-11T15:59:20.083 INFO:tasks.workunit:cleanup=True 2024-06-11T15:59:20.083 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.086 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:20.086 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:20.101 INFO:teuthology.orchestra.run.smithi089.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:fusefs_t:s0 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-06-11 15:58:59.193589799 +0000 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-06-11 15:59:20.068554089 +0000 2024-06-11T15:59:20.102 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2024-06-11T15:59:20.102 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-11T15:59:20.103 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-11T15:59:20.151 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:20.152+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:20.157 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.021311900000001, 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.158 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:20.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:20.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:20.164 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.972609111000001, 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:20.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:20.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:20.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:20.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.676041392999998, 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:20.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:20.176 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.675991238999998, 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.177 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:20.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.182 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.675976573, 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:20.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:20.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:20.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:20.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.188 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.544184262000002, 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:20.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:20.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:20.194 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.544157022, 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:20.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:20.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.544132824999998, 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.200 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:20.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:20.205 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.544058914000001, 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.206 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.211 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.338054661000001, 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.212 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:20.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 27.337974706000001, 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:20.218 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:20.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:20.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.223 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.960135154, 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:20.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.960100531999998, 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.229 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.960069961999999, 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:20.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:20.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.960044584999999, 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.240 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:20.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:20.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.960020063999998, 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:20.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:20.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.959996575000002, 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:20.251 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:20.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.256 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.959795694, 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.257 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:20.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.959718562999999, 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:20.262 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:20.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.267 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 20.959536467, 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.268 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:20.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:20.272 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:20.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:20.274+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:20.275 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3f51ea3944d39ca13aa40153c9a4ee298306679d 2024-06-11T15:59:20.275 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:20.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T15:59:20.330 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-11T15:59:20.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:20.376+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:20.390 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:20.390 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:20.391 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:20.391 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:20.399 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:20.475 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:20.476+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:20.505 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:20.506 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:20.506 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:20.506 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:20.506 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:20.515 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:20.599 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:20.600+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:20.661 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:20.661 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:20.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:20.661 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.464524527999998, 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:20.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:20.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:20.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.667 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.464367538000001, 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:20.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:20.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.464327129000001, 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:20.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.464253410000001, 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:20.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.685 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.46411595, 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:20.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:20.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.691 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.464082146999999, 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:20.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.463777352000001, 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:20.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:20.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.463695091000002, 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:20.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.463653569000002, 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.706 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:20.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:20.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:20.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:20.711 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.462701663000001, 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:20.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.462634786999999, 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.716 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:20.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.720 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.462319234999999, 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:20.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.724 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.461774086999998, 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:20.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:20.729 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.461434128, 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:20.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:20.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.459317829, 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:20.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.458917418999999, 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:20.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:20.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:20.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.458599105000001, 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000183544, 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.742 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202427+0000", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3900000000000004e-07 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202432+0000", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5179999999999998e-06 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202440+0000", 2024-06-11T15:59:20.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7609999999999996e-06 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202447+0000", 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9110000000000004e-06 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202596+0000", 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014922899999999999 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7459999999999997e-06 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202610+0000", 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.746 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 19.465763573, 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:20.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:20.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.46378084600000002, 2024-06-11T15:59:20.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:20.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.46225875900000002, 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:20.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:20.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:20.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:20.762 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:20.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:20.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:20.765+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:20.865 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:20.866+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:20.882 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:20.882 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:20.882 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:20.882 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:20.891 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:20.965 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:20.966+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:20.996 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:20.996 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:20.996 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:20.996 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:20.996 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:21.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:21.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:21.067+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.112 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.628572886000001, 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:21.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.628011622999999, 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.117 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.625745597000002, 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.625191388000001, 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.617982505000001, 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.617555469999999, 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 28.159575378, 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.914123473, 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.914008204000002, 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913976402999999, 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913919639, 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913893136999999, 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913864090000001, 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913813032, 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.913761398999998, 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.907579312999999, 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.903257805999999, 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.903081992000001, 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.903013843, 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.902954301000001, 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:21.215 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:21.216 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:21.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:21.217+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:21.269 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T15:59:21.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:21.318+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:21.332 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:21.333 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:21.342 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:21.418 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:21.419+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:21.447 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:21.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:21.447 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:21.447 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:21.448 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:21.456 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:21.518 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:21.518+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:21.563 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:21.563 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:21.563 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:21.563 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 30.427082664, 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:21.564 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.565 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.566 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:21.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:21.568 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.570 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.378379875, 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.571 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:21.573 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.574 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:21.575 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.576 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.081812157000002, 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.577 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.578 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.579 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.580 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.581 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.582 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.081762003000001, 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.583 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:21.584 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.585 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:21.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.588 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.081747336999999, 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:21.589 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.590 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.591 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.592 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:21.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.594 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.949955026000001, 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:21.595 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:21.596 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:21.597 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:21.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.600 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.601 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.949927786, 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.602 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.605 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:21.606 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:21.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.609 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.949903589000002, 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.611 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.612 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:21.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.949829678, 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:21.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:21.620 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.621 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.743825425000001, 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:21.622 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:21.626 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.627 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 28.74374547, 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.628 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:21.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:21.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:21.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365905917999999, 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.634 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:21.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.639 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365871296000002, 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:21.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.644 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365840725999998, 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.645 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:21.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:21.650 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365815349000002, 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:21.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.656 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365790828000002, 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:21.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:21.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365767339000001, 2024-06-11T15:59:21.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:21.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365566458, 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:21.668 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:21.673 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365489326999999, 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:21.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:21.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 22.365307230999999, 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:21.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:21.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:21.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:21.684 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:21.685 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:21.685+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:21.686 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:21.785 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:21.786+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:21.801 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:21.801 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:21.802 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:21.802 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:21.811 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:21.886 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:21.887+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:21.916 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:21.916 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:21.916 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:21.916 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:21.916 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:21.924 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:21.987 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:21.987+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:22.030 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:22.030 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:22.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.834108739000001, 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:22.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:22.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.036 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833951749000001, 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:22.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.83391134, 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.042 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:22.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:22.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833837621000001, 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833700160999999, 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.053 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833666357999999, 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:22.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:22.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.064 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833361563, 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:22.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833279302000001, 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.069 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:22.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.833237780000001, 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:22.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.832285874, 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:22.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:22.082 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.832218997999998, 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:22.086 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.831903445999998, 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:22.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.831358298000001, 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:22.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.831018339, 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:22.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:22.100 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.828902039999999, 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:22.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:22.104 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.828501630000002, 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:22.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.828183316000001, 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000183544, 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:22.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202427+0000", 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3900000000000004e-07 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202432+0000", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5179999999999998e-06 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202440+0000", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7609999999999996e-06 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202447+0000", 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9110000000000004e-06 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202596+0000", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014922899999999999 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7459999999999997e-06 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202610+0000", 2024-06-11T15:59:22.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 20.835347784, 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.113 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:22.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.118 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.833365057, 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:22.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:22.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:22.124 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.8318429699999998, 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:22.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:22.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:22.128 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:22.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:22.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:22.131+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:22.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:22.231 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:22.231+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:22.242 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:22.242 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:22.242 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:22.242 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:22.251 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:22.263 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:22.263 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:22.285 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:22.285 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:22.302 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:22.332 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:22.332+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:22.355 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.355 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:22.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:22.433+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:22.470 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.470 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.479 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:22.534 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:22.534+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:22.591 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.591 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.599 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:22.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:22.635+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:22.704 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.704 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.713 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:22.735 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:22.736+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:22.817 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.817 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.830 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:22.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:22.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:22.861 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-06-11T15:59:22.861 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-06-11T15:59:22.861 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-06-11T15:59:22.861 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-06-11T15:59:22.874 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:22.874+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:22.937 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:22.936+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:22.945 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:22.945 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:22.955 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:22.965 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-06-11T15:59:22.966 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:23.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:23.039+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:23.100 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.100 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.109 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:23.140 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.140+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.214 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.214 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:23.242 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:23.242+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:23.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T15:59:23.336 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.337 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.343 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.343+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:23.446 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.447+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.451 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.451 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:23.547 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.548+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.564 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.565 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.574 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:23.650 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.649+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.682 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.682 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:23.776 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.777+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.835 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.836 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:23.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:23.853+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:23.952 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:23.953+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:23.989 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:23.989 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:23.998 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:24.053 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:24.053+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:24.113 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:24.114 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:24.122 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:24.166 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:24.166+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:24.228 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:24.228 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:24.236 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:24.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:24.255+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:24.286 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T15:59:24.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:24.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:24.356+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:24.381 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:24.381 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:24.390 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:24.437 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:24.438 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:24.456 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:24.456 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:24.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:24.456+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:24.473 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:24.474 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:24.502 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:24.502 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:24.502 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:24.502 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:24.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:24.557 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:24.558+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:24.656 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:24.656 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:24.656 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:24.656 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:24.656 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:24.657 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:24.658+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:24.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:24.759 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:24.759+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:24.773 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:24.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.289038623000003, 2024-06-11T15:59:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:24.774 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:24.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:24.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.288477360000002, 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:24.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:24.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:24.792 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.286211334000001, 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:24.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.798 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.285657125, 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.799 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:24.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:24.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:24.804 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.278448242000003, 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:24.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.278021207000002, 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.810 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:24.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:24.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.815 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 31.820041114999999, 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:24.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:24.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:24.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:24.821 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574589209999999, 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:24.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:24.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574473941000001, 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574442139999999, 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574385375999999, 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574358874000001, 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574329827, 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574278768999999, 2024-06-11T15:59:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.574227136000001, 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.568045049999998, 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.563723543000002, 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.563547729, 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.563479579999999, 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.563420038, 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:24.904 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:24.905 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:24.906+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:24.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:25.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:25.008+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:25.022 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:25.023 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:25.023 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:25.023 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:25.032 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:25.107 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:25.108+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:25.137 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:25.137 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:25.137 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:25.137 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:25.137 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:25.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:25.208 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:25.209+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:25.252 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:25.252 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:25.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:25.252 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:25.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 34.116020108000001, 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.253 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:25.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:25.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 33.067317318999997, 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:25.261 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.263 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:25.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:25.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:25.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.770749600999999, 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.269 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:25.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:25.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:25.274 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.275 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.770699446999998, 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.276 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:25.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:25.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:25.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:25.282 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.770684781, 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.283 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.285 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:25.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:25.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.291 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.638892470000002, 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.292 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:25.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.298 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.63886523, 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:25.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:25.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:25.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:25.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.305 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.638841032999999, 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.306 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:25.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.310 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:25.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.312 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.638767121999997, 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.313 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:25.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.317 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:25.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.432762869000001, 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.320 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.321 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.322 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:25.323 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.324 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.325 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:25.326 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 32.432682913999997, 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.327 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.328 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:25.329 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:25.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:25.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.333 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054843362, 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.334 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:25.335 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.336 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:25.338 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:25.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:25.340 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054808739999999, 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.341 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.342 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:25.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.345 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:25.346 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054778169999999, 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.347 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.349 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:25.350 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.351 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.352 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.353 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054752792999999, 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.354 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:25.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:25.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.358 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.359 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054728271999998, 2024-06-11T15:59:25.360 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.361 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.363 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:25.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.365 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054704782999998, 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:25.367 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.368 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:25.369 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:25.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.371 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:25.373 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054503902, 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.374 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.376 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:25.377 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:25.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.379 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.380 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054426770999999, 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.382 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.383 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:25.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.385 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.386 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 26.054244675, 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:25.387 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:25.388 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:25.389 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:25.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:25.392 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:25.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:25.395+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:25.394 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:25.495 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:25.494+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:25.512 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:25.512 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:25.512 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:25.512 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:25.522 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:25.606 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:25.606+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:25.668 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:25.668 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:25.668 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:25.668 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:25.668 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:25.677 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:25.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:25.698+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:25.798 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:25.798+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:25.824 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:25.824 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:25.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:25.824 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:25.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627792864, 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:25.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:25.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:25.830 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627635873999999, 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:25.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627595464999999, 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.836 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:25.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:25.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:25.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.842 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627521745999999, 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:25.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:25.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627384286000002, 2024-06-11T15:59:25.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627350483000001, 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:25.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:25.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:25.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.627045687999999, 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.862 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.626963427, 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:25.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:25.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:25.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.626921905, 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:25.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.625969998999999, 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.625903123000001, 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:25.875 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:25.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:25.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.879 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.625587571000001, 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:25.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.625042423, 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:25.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:25.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.624702463999999, 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:25.894 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.622586165000001, 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:25.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.622185755, 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.901 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:25.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:25.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:25.905 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.621867440999999, 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000183544, 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:25.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202426+0000", 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202427+0000", 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3900000000000004e-07 2024-06-11T15:59:25.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202432+0000", 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5179999999999998e-06 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202440+0000", 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7609999999999996e-06 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202447+0000", 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9110000000000004e-06 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202596+0000", 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014922899999999999 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7459999999999997e-06 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202610+0000", 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 24.629031908999998, 2024-06-11T15:59:25.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.916 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.6270491820000004, 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:25.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:25.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:25.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:25.923 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.6255270949999998, 2024-06-11T15:59:25.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:25.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:25.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:25.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.930 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:25.931 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:25.931 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:25.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:25.934+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:25.933 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:26.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.035+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.051 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:26.051 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:26.051 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:26.051 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:26.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:26.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.147+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.206 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:26.207 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:26.207 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:26.207 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:26.207 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:26.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:26.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.257+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T15:59:26.336 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:26.336+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.878612085, 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.878050821999999, 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.875784795999998, 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.875230586999997, 2024-06-11T15:59:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.868021704, 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.867594668999999, 2024-06-11T15:59:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 33.409614576999999, 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.164162672, 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.164047403000001, 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.164015601999999, 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.163958837999999, 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.163932335999998, 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:26.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:26.423 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.163903289, 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:26.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:26.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.163852231, 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.429 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:26.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:26.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.163800598000002, 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.435 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:26.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:26.439 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.157618511999999, 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.153297004999999, 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:26.444 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.153121191, 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.153053042, 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:26.453 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:26.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.152993500000001, 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:26.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:26.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:26.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:26.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:26.462 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:26.464 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:26.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.464+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:26.564 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:26.565+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:26.581 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:26.581 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:26.581 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:26.582 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:26.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:26.628 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:26.628 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:26.650 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:26.651 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:26.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.666+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.669 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:26.669 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:26.737 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:26.738 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:26.746 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:26.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:26.767+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:26.852 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:26.852 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:26.863 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:26.868 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:26.868+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:26.968 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:26.969+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:26.980 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:26.980 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:26.989 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:27.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:27.070+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:27.093 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.094 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.102 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:27.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:27.171+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:27.205 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.206 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:27.271 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:27.272+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:27.293 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T15:59:27.326 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.326 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.335 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:27.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:27.379+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:27.439 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.440 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:27.473 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:27.474+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:27.574 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:27.575+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:27.593 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.593 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.602 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:27.675 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:27.676+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:27.712 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.712 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.721 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:27.776 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:27.776+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:27.825 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.825 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.834 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:27.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:27.878+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:27.976 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:27.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:27.976 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-06-11T15:59:27.977 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.359086 2024-06-11T15:59:27.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.35908647050724474 2024-06-11T15:59:27.979 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:27.979 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:27.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:27.979+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:27.988 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:28.080 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:28.080+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:28.104 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.105 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.114 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:28.200 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:28.201+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:28.262 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.262 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.271 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:28.297 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.1 primary-affinity to 0.359086 (8235332) 2024-06-11T15:59:28.312 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:28.313+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:28.382 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:28.383+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:28.416 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.416 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:28.483 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:28.483+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:28.534 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.534 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:28.584 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:28.584+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:28.648 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.648 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.657 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:28.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:28.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:28.702+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:28.762 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:28.763 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:28.771 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:28.803 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:28.803 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:28.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:28.813+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:28.821 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:28.821 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:28.839 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:28.839 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:28.884 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:28.884 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:28.884 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:28.884 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:28.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:28.887+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:28.893 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:28.988 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:28.988+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:28.997 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:28.997 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:28.997 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:28.997 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:28.997 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:29.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:29.090 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:29.091+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 38.017681047000004, 2024-06-11T15:59:29.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:29.155 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:29.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:29.162 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.968978258, 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.163 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:29.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.169 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.672410540000001, 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:29.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.672360386000001, 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.176 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:29.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:29.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:29.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:29.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.672345720000003, 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.185 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:29.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:29.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:29.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.540553408999997, 2024-06-11T15:59:29.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:29.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.540526169000003, 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.197 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:29.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:29.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:29.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:29.203 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.540501972000001, 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:29.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:29.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:29.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:29.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.540428061, 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.209 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:29.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.215 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.334423807999997, 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.216 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:29.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 36.334343853, 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:29.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:29.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:29.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956504300999999, 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:29.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:29.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:29.234 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956469679000001, 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:29.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:29.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.239 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956439109000002, 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.240 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.245 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956413732000001, 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:29.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:29.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956389211000001, 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:29.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:29.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:29.256 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956365722000001, 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.257 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:29.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956164841, 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.263 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:29.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:29.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.956087709999998, 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:29.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:29.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.274 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 29.955905613999999, 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:29.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:29.278 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.279 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.279 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.279 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:29.279 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:29.279 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:29.280 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:29.281 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:29.281+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:29.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T15:59:29.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:29.382+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:29.398 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:29.398 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:29.398 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:29.398 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:29.407 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:29.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:29.483+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:29.513 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:29.513 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:29.513 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:29.513 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:29.513 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:29.523 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:29.584 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:29.584+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:29.630 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:29.630 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433921253000001, 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:29.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:29.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:29.636 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433764263, 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.637 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:29.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:29.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433723854, 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433650135000001, 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433512674999999, 2024-06-11T15:59:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433478871999998, 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433174077, 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433091816000001, 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.433050294000001, 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.432098388, 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.432031512000002, 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.431715959999998, 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.431170812000001, 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.430830853, 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.428714553999999, 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.428314144000002, 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 28.435160298, 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.4331775709999999, 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:29.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:29.721 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.4316554840000002, 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:29.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.432258574, 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:29.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:29.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:29.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:29.731 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:29.732 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:29.733+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:29.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:29.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:29.834+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:29.842 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:29.842 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:29.843 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:29.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:29.934 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:29.935+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:29.997 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:29.997 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:29.997 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:29.997 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:29.997 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:30.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:30.035 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:30.036+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.629822402999999, 2024-06-11T15:59:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.629261139999997, 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.626995114000003, 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.626440905000003, 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.619232021999998, 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.618804986999997, 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.160824894999998, 2024-06-11T15:59:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915372990000002, 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915257721, 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915225920000001, 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915169156000001, 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915142654, 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915113606999999, 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.174 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915062548999998, 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:30.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:30.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:30.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.915010916, 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:30.185 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:30.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:30.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.908828830000001, 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:30.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.904507323000001, 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:30.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:30.198 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.904331508999999, 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.904263360000002, 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:30.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:30.207 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.904203817999999, 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:30.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:30.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:30.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:30.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:30.215 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:30.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:30.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:30.217+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:30.313 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T15:59:30.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:30.318+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:30.334 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:30.335 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:30.335 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:30.335 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:30.345 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:30.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:30.419+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:30.450 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:30.450 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:30.450 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:30.450 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:30.450 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:30.459 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:30.519 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:30.520+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:30.565 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.428629548000004, 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.566 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:30.567 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:30.568 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.569 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:30.570 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.571 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.572 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 38.379926759, 2024-06-11T15:59:30.573 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:30.574 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.575 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.575 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.575 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.575 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:30.575 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:30.576 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.577 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.578 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:30.579 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.580 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.581 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 38.083359041000001, 2024-06-11T15:59:30.582 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.583 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.584 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.585 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.586 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:30.587 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:30.588 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.589 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 38.083308887000001, 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.590 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.591 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.592 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:30.593 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.594 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:30.595 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:30.596 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 38.083294221000003, 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.597 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.598 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.599 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:30.600 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.601 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.602 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.603 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.951501909999998, 2024-06-11T15:59:30.604 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.605 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:30.606 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.607 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.608 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:30.609 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.610 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:30.611 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.951474670000003, 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.612 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.613 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:30.614 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.615 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.616 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:30.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.951450473000001, 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.618 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:30.620 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:30.621 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.622 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:30.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.626 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.951376562, 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.627 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:30.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.633 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.745372308999997, 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:30.634 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.638 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.640 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 37.745292354, 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:30.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:30.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.647 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367452801999999, 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367418180000001, 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367387610000002, 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367362233000001, 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367337712000001, 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367314223000001, 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:30.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:30.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:30.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367113342, 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:30.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:30.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:30.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.367036210999999, 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:30.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:30.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 31.366854114999999, 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:30.700 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:30.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:30.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:30.704 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:30.706 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:30.707 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:30.706+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:30.806 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:30.807+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:30.823 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:30.823 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:30.823 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:30.823 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:30.832 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:30.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:30.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:30.908+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:30.977 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:30.977 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:30.977 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:30.977 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:30.977 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:30.983 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:30.983 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:30.987 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:31.001 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:31.002 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:31.019 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:31.019 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:31.031 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:31.032+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:31.091 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.091 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.101 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:31.142 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:31.143+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:31.209 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:31.210+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:31.310 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:31.310+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.329 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.338 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:31.410 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:31.411+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:31.443 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.444 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.453 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:31.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:31.512+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:31.570 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.570 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.579 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:31.613 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:31.614+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:31.684 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.684 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.694 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:31.738 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:31.739+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:31.800 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.800 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.809 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:31.854 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:31.855+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:31.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:31.915+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:31.918 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:31.918 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:31.928 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:32.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:32.016+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:32.072 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.072 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:32.116 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:32.116+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:32.187 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.187 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.196 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:32.216 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:32.217+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:32.311 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.311 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.317 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:32.317+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:32.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:32.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T15:59:32.418 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:32.419+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:32.427 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.427 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.436 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:32.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:32.519+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:32.540 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.541 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.549 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:32.620 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:32.620+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:32.661 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.662 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.670 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:32.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:32.721+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:32.815 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.815 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.821 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:32.821+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:32.825 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:32.921 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:32.922+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:32.930 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:32.930 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:32.939 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:33.022 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:33.022+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:33.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:33.047 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:33.047 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:33.056 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:33.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:33.123+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:33.160 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:33.160 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:33.169 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:33.175 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:33.175 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:33.208 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:33.208 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:33.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:33.224+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:33.238 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:33.238 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:33.275 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:33.275 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:33.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:33.275 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078917124, 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:33.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.281 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078760133999999, 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:33.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:33.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.287 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078719724999999, 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:33.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:33.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.293 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078646006, 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:33.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:33.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078508546000002, 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:33.299 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:33.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078474743000001, 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:33.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:33.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:33.310 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078169948000003, 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:33.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:33.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078087687, 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:33.315 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:33.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.319 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.078046165000003, 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.077094258999999, 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:33.324 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:33.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.077027383000001, 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:33.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:33.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.333 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.076711830999997, 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:33.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:33.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.337 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.076166682999997, 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:33.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:33.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:33.342 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.075826724000002, 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:33.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:33.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.073710425000002, 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:33.347 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.073310014999997, 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.351 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:33.355 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.080156168999999, 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:33.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.078173442000001, 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:33.361 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:33.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:33.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.076651354999999, 2024-06-11T15:59:33.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:33.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:33.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.371 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.0772544450000003, 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:33.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:33.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:33.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:33.377 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:33.377 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:33.377 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:33.378 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-06-11T15:59:33.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T15:59:33.380 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T15:59:33.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:33.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:33.380+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:33.481 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:33.482+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:33.493 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:33.493 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:33.493 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:33.493 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:33.502 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:33.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:33.582+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:33.607 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:33.607 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:33.607 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:33.607 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:33.608 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:33.617 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:33.683 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:33.684+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:33.726 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T15:59:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 27, 2024-06-11T15:59:33.726 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T15:59:33.305431+0000", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:58:47.789155+0000", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T15:59:33.727 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T15:59:33.728 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T15:59:33.729 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T15:59:33.730 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T15:59:33.731 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T15:59:33.732 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T15:59:33.733 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T15:59:33.734 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T15:59:33.735 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2.9900000095367432, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2.9900000095367432, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 0.67000001668930054, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.7863616943359375, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.79000002145767212, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T15:59:33.736 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T15:59:33.737 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T15:59:33.738 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T15:59:33.739 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T15:59:33.740 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T15:59:33.741 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.5, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.5, 2024-06-11T15:59:33.742 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.5, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.5, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.7863616943359375, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.79000002145767212, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T15:59:33.743 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T15:59:33.744 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T15:59:33.745 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T15:59:33.746 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T15:59:33.747 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T15:59:33.748 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T15:59:33.749 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.309999942779541, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.309999942779541, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.309999942779541, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.309999942779541, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.7863616943359375, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.79000002145767212, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T15:59:33.750 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T15:59:33.751 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T15:59:33.752 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T15:59:33.753 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T15:59:33.754 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T15:59:33.755 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T15:59:33.756 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 1.3600000143051147, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 1.3600000143051147, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 1.3600000143051147, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 1.3600000143051147, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.7863616943359375, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 0.79000002145767212, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.79000002145767212 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T15:59:33.757 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 24, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T15:59:33.758 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T15:59:33.759 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T15:59:33.760 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.761 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.762 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T15:59:33.763 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.3590850830078125, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T15:59:33.764 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 17, 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.765 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.766 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T15:59:33.766 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.766 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.766 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.767 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.768 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T15:59:33.769 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.770 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 24, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T15:59:33.771 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.772 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T15:59:33.773 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.774 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.775 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T15:59:33.776 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.777 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T15:59:33.778 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T15:59:33.779 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T15:59:33.780 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T15:59:33.781 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T15:59:33.784 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T15:59:33.305431+0000', 'last_up_change': '2024-06-11T15:58:47.789155+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7863616943359375, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7863616943359375, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7863616943359375, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 0.7863616943359375, 'average_primary_affinity': 0.7900000214576721, 'average_primary_affinity_weighted': 0.7900000214576721}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3590850830078125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T15:59:33.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.280681862000002, 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:33.785 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:33.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:33.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.280120599, 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.790 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:33.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:33.794 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.277854572999999, 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:33.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:33.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.277300363999998, 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:33.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:33.804 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.270091481000001, 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:33.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.269664446, 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.809 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:33.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.811684354, 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:33.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.566232448999997, 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.824 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.566117179999999, 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:33.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:33.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:33.830 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.566085379, 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:33.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:33.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.566028615, 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:33.836 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:33.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:33.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:33.842 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.566002113000003, 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:33.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:33.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.565973065999998, 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:33.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:33.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:33.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.565922008000001, 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:33.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:33.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.565870375000003, 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:33.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:33.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.559688289, 2024-06-11T15:59:33.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:33.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:33.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.555366782, 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.869 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:33.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:33.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.555190967999998, 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:33.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:33.878 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.555122818999997, 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:33.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:33.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.555063277000002, 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:33.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:33.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:33.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:33.889 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:33.889 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:33.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:33.891+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:33.991 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:33.992+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:34.007 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:34.008 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:34.008 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:34.008 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:34.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:34.092 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:34.093+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:34.122 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:34.122 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:34.123 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:34.123 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:34.123 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:34.131 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:34.200 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T15:59:34.246 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T15:59:34.247 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-06-11T15:59:33.582654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597718,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90216,"kb_used_data":832,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025304,"statfs":{"total":289910292480,"available":289817911296,"internally_reserved":0,"allocated":851968,"data_stored":1456208,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4784,"internal_metadata":91483472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.285524"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312966+0000","last_change":"2024-06-11T15:59:29.308333+0000","last_active":"2024-06-11T15:59:30.312966+0000","last_peered":"2024-06-11T15:59:30.312966+0000","last_clean":"2024-06-11T15:59:30.312966+0000","last_became_active":"2024-06-11T15:59:29.307745+0000","last_became_peered":"2024-06-11T15:59:29.307745+0000","last_unstale":"2024-06-11T15:59:30.312966+0000","last_undegraded":"2024-06-11T15:59:30.312966+0000","last_fullsized":"2024-06-11T15:59:30.312966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314810+0000","last_change":"2024-06-11T15:58:59.197373+0000","last_active":"2024-06-11T15:59:30.314810+0000","last_peered":"2024-06-11T15:59:30.314810+0000","last_clean":"2024-06-11T15:59:30.314810+0000","last_became_active":"2024-06-11T15:58:59.195685+0000","last_became_peered":"2024-06-11T15:58:59.195685+0000","last_unstale":"2024-06-11T15:59:30.314810+0000","last_undegraded":"2024-06-11T15:59:30.314810+0000","last_fullsized":"2024-06-11T15:59:30.314810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014756+0000","last_change":"2024-06-11T15:58:59.205860+0000","last_active":"2024-06-11T15:59:31.014756+0000","last_peered":"2024-06-11T15:59:31.014756+0000","last_clean":"2024-06-11T15:59:31.014756+0000","last_became_active":"2024-06-11T15:58:59.203306+0000","last_became_peered":"2024-06-11T15:58:59.203306+0000","last_unstale":"2024-06-11T15:59:31.014756+0000","last_undegraded":"2024-06-11T15:59:31.014756+0000","last_fullsized":"2024-06-11T15:59:31.014756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014680+0000","last_change":"2024-06-11T15:58:59.205278+0000","last_active":"2024-06-11T15:59:31.014680+0000","last_peered":"2024-06-11T15:59:31.014680+0000","last_clean":"2024-06-11T15:59:31.014680+0000","last_became_active":"2024-06-11T15:58:59.203743+0000","last_became_peered":"2024-06-11T15:58:59.203743+0000","last_unstale":"2024-06-11T15:59:31.014680+0000","last_undegraded":"2024-06-11T15:59:31.014680+0000","last_fullsized":"2024-06-11T15:59:31.014680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312026+0000","last_change":"2024-06-11T15:59:29.308058+0000","last_active":"2024-06-11T15:59:30.312026+0000","last_peered":"2024-06-11T15:59:30.312026+0000","last_clean":"2024-06-11T15:59:30.312026+0000","last_became_active":"2024-06-11T15:59:29.307440+0000","last_became_peered":"2024-06-11T15:59:29.307440+0000","last_unstale":"2024-06-11T15:59:30.312026+0000","last_undegraded":"2024-06-11T15:59:30.312026+0000","last_fullsized":"2024-06-11T15:59:30.312026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:33:54.815101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014329+0000","last_change":"2024-06-11T15:58:59.202013+0000","last_active":"2024-06-11T15:59:31.014329+0000","last_peered":"2024-06-11T15:59:31.014329+0000","last_clean":"2024-06-11T15:59:31.014329+0000","last_became_active":"2024-06-11T15:58:59.201309+0000","last_became_peered":"2024-06-11T15:58:59.201309+0000","last_unstale":"2024-06-11T15:59:31.014329+0000","last_undegraded":"2024-06-11T15:59:31.014329+0000","last_fullsized":"2024-06-11T15:59:31.014329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014311+0000","last_change":"2024-06-11T15:58:59.202855+0000","last_active":"2024-06-11T15:59:31.014311+0000","last_peered":"2024-06-11T15:59:31.014311+0000","last_clean":"2024-06-11T15:59:31.014311+0000","last_became_active":"2024-06-11T15:58:59.202465+0000","last_became_peered":"2024-06-11T15:58:59.202465+0000","last_unstale":"2024-06-11T15:59:31.014311+0000","last_undegraded":"2024-06-11T15:59:31.014311+0000","last_fullsized":"2024-06-11T15:59:31.014311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014160+0000","last_change":"2024-06-11T15:58:59.205292+0000","last_active":"2024-06-11T15:59:31.014160+0000","last_peered":"2024-06-11T15:59:31.014160+0000","last_clean":"2024-06-11T15:59:31.014160+0000","last_became_active":"2024-06-11T15:58:59.203647+0000","last_became_peered":"2024-06-11T15:58:59.203647+0000","last_unstale":"2024-06-11T15:59:31.014160+0000","last_undegraded":"2024-06-11T15:59:31.014160+0000","last_fullsized":"2024-06-11T15:59:31.014160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312650+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T15:59:30.312650+0000","last_peered":"2024-06-11T15:59:30.312650+0000","last_clean":"2024-06-11T15:59:30.312650+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T15:59:30.312650+0000","last_undegraded":"2024-06-11T15:59:30.312650+0000","last_fullsized":"2024-06-11T15:59:30.312650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314874+0000","last_change":"2024-06-11T15:58:59.197653+0000","last_active":"2024-06-11T15:59:30.314874+0000","last_peered":"2024-06-11T15:59:30.314874+0000","last_clean":"2024-06-11T15:59:30.314874+0000","last_became_active":"2024-06-11T15:58:59.196457+0000","last_became_peered":"2024-06-11T15:58:59.196457+0000","last_unstale":"2024-06-11T15:59:30.314874+0000","last_undegraded":"2024-06-11T15:59:30.314874+0000","last_fullsized":"2024-06-11T15:59:30.314874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014708+0000","last_change":"2024-06-11T15:58:59.205332+0000","last_active":"2024-06-11T15:59:31.014708+0000","last_peered":"2024-06-11T15:59:31.014708+0000","last_clean":"2024-06-11T15:59:31.014708+0000","last_became_active":"2024-06-11T15:58:59.202684+0000","last_became_peered":"2024-06-11T15:58:59.202684+0000","last_unstale":"2024-06-11T15:59:31.014708+0000","last_undegraded":"2024-06-11T15:59:31.014708+0000","last_fullsized":"2024-06-11T15:59:31.014708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014735+0000","last_change":"2024-06-11T15:59:29.307817+0000","last_active":"2024-06-11T15:59:31.014735+0000","last_peered":"2024-06-11T15:59:31.014735+0000","last_clean":"2024-06-11T15:59:31.014735+0000","last_became_active":"2024-06-11T15:59:29.307542+0000","last_became_peered":"2024-06-11T15:59:29.307542+0000","last_unstale":"2024-06-11T15:59:31.014735+0000","last_undegraded":"2024-06-11T15:59:31.014735+0000","last_fullsized":"2024-06-11T15:59:31.014735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:59:21.672510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312431+0000","last_change":"2024-06-11T15:59:29.308484+0000","last_active":"2024-06-11T15:59:30.312431+0000","last_peered":"2024-06-11T15:59:30.312431+0000","last_clean":"2024-06-11T15:59:30.312431+0000","last_became_active":"2024-06-11T15:59:29.308104+0000","last_became_peered":"2024-06-11T15:59:29.308104+0000","last_unstale":"2024-06-11T15:59:30.312431+0000","last_undegraded":"2024-06-11T15:59:30.312431+0000","last_fullsized":"2024-06-11T15:59:30.312431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014415+0000","last_change":"2024-06-11T15:58:59.201563+0000","last_active":"2024-06-11T15:59:31.014415+0000","last_peered":"2024-06-11T15:59:31.014415+0000","last_clean":"2024-06-11T15:59:31.014415+0000","last_became_active":"2024-06-11T15:58:59.200891+0000","last_became_peered":"2024-06-11T15:58:59.200891+0000","last_unstale":"2024-06-11T15:59:31.014415+0000","last_undegraded":"2024-06-11T15:59:31.014415+0000","last_fullsized":"2024-06-11T15:59:31.014415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014343+0000","last_change":"2024-06-11T15:58:59.202500+0000","last_active":"2024-06-11T15:59:31.014343+0000","last_peered":"2024-06-11T15:59:31.014343+0000","last_clean":"2024-06-11T15:59:31.014343+0000","last_became_active":"2024-06-11T15:58:59.201051+0000","last_became_peered":"2024-06-11T15:58:59.201051+0000","last_unstale":"2024-06-11T15:59:31.014343+0000","last_undegraded":"2024-06-11T15:59:31.014343+0000","last_fullsized":"2024-06-11T15:59:31.014343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014231+0000","last_change":"2024-06-11T15:58:59.206087+0000","last_active":"2024-06-11T15:59:31.014231+0000","last_peered":"2024-06-11T15:59:31.014231+0000","last_clean":"2024-06-11T15:59:31.014231+0000","last_became_active":"2024-06-11T15:58:59.203877+0000","last_became_peered":"2024-06-11T15:58:59.203877+0000","last_unstale":"2024-06-11T15:59:31.014231+0000","last_undegraded":"2024-06-11T15:59:31.014231+0000","last_fullsized":"2024-06-11T15:59:31.014231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.313025+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T15:59:30.313025+0000","last_peered":"2024-06-11T15:59:30.313025+0000","last_clean":"2024-06-11T15:59:30.313025+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T15:59:30.313025+0000","last_undegraded":"2024-06-11T15:59:30.313025+0000","last_fullsized":"2024-06-11T15:59:30.313025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314993+0000","last_change":"2024-06-11T15:58:59.195308+0000","last_active":"2024-06-11T15:59:30.314993+0000","last_peered":"2024-06-11T15:59:30.314993+0000","last_clean":"2024-06-11T15:59:30.314993+0000","last_became_active":"2024-06-11T15:58:59.193203+0000","last_became_peered":"2024-06-11T15:58:59.193203+0000","last_unstale":"2024-06-11T15:59:30.314993+0000","last_undegraded":"2024-06-11T15:59:30.314993+0000","last_fullsized":"2024-06-11T15:59:30.314993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312456+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T15:59:30.312456+0000","last_peered":"2024-06-11T15:59:30.312456+0000","last_clean":"2024-06-11T15:59:30.312456+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T15:59:30.312456+0000","last_undegraded":"2024-06-11T15:59:30.312456+0000","last_fullsized":"2024-06-11T15:59:30.312456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014839+0000","last_change":"2024-06-11T15:58:59.205275+0000","last_active":"2024-06-11T15:59:31.014839+0000","last_peered":"2024-06-11T15:59:31.014839+0000","last_clean":"2024-06-11T15:59:31.014839+0000","last_became_active":"2024-06-11T15:58:59.204000+0000","last_became_peered":"2024-06-11T15:58:59.204000+0000","last_unstale":"2024-06-11T15:59:31.014839+0000","last_undegraded":"2024-06-11T15:59:31.014839+0000","last_fullsized":"2024-06-11T15:59:31.014839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:54:08.928372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014703+0000","last_change":"2024-06-11T15:58:59.204779+0000","last_active":"2024-06-11T15:59:31.014703+0000","last_peered":"2024-06-11T15:59:31.014703+0000","last_clean":"2024-06-11T15:59:31.014703+0000","last_became_active":"2024-06-11T15:58:59.203636+0000","last_became_peered":"2024-06-11T15:58:59.203636+0000","last_unstale":"2024-06-11T15:59:31.014703+0000","last_undegraded":"2024-06-11T15:59:31.014703+0000","last_fullsized":"2024-06-11T15:59:31.014703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014240+0000","last_change":"2024-06-11T15:59:29.307846+0000","last_active":"2024-06-11T15:59:31.014240+0000","last_peered":"2024-06-11T15:59:31.014240+0000","last_clean":"2024-06-11T15:59:31.014240+0000","last_became_active":"2024-06-11T15:59:29.307535+0000","last_became_peered":"2024-06-11T15:59:29.307535+0000","last_unstale":"2024-06-11T15:59:31.014240+0000","last_undegraded":"2024-06-11T15:59:31.014240+0000","last_fullsized":"2024-06-11T15:59:31.014240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:09:08.885403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311757+0000","last_change":"2024-06-11T15:58:59.200502+0000","last_active":"2024-06-11T15:59:30.311757+0000","last_peered":"2024-06-11T15:59:30.311757+0000","last_clean":"2024-06-11T15:59:30.311757+0000","last_became_active":"2024-06-11T15:58:59.199861+0000","last_became_peered":"2024-06-11T15:58:59.199861+0000","last_unstale":"2024-06-11T15:59:30.311757+0000","last_undegraded":"2024-06-11T15:59:30.311757+0000","last_fullsized":"2024-06-11T15:59:30.311757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:52:07.705848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311939+0000","last_change":"2024-06-11T15:59:29.303643+0000","last_active":"2024-06-11T15:59:30.311939+0000","last_peered":"2024-06-11T15:59:30.311939+0000","last_clean":"2024-06-11T15:59:30.311939+0000","last_became_active":"2024-06-11T15:59:29.303337+0000","last_became_peered":"2024-06-11T15:59:29.303337+0000","last_unstale":"2024-06-11T15:59:30.311939+0000","last_undegraded":"2024-06-11T15:59:30.311939+0000","last_fullsized":"2024-06-11T15:59:30.311939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:10:30.771690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015059+0000","last_change":"2024-06-11T15:59:29.307532+0000","last_active":"2024-06-11T15:59:31.015059+0000","last_peered":"2024-06-11T15:59:31.015059+0000","last_clean":"2024-06-11T15:59:31.015059+0000","last_became_active":"2024-06-11T15:59:29.307194+0000","last_became_peered":"2024-06-11T15:59:29.307194+0000","last_unstale":"2024-06-11T15:59:31.015059+0000","last_undegraded":"2024-06-11T15:59:31.015059+0000","last_fullsized":"2024-06-11T15:59:31.015059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:58:06.252358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312667+0000","last_change":"2024-06-11T15:58:59.200417+0000","last_active":"2024-06-11T15:59:30.312667+0000","last_peered":"2024-06-11T15:59:30.312667+0000","last_clean":"2024-06-11T15:59:30.312667+0000","last_became_active":"2024-06-11T15:58:59.199951+0000","last_became_peered":"2024-06-11T15:58:59.199951+0000","last_unstale":"2024-06-11T15:59:30.312667+0000","last_undegraded":"2024-06-11T15:59:30.312667+0000","last_fullsized":"2024-06-11T15:59:30.312667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014861+0000","last_change":"2024-06-11T15:58:59.205307+0000","last_active":"2024-06-11T15:59:31.014861+0000","last_peered":"2024-06-11T15:59:31.014861+0000","last_clean":"2024-06-11T15:59:31.014861+0000","last_became_active":"2024-06-11T15:58:59.203093+0000","last_became_peered":"2024-06-11T15:58:59.203093+0000","last_unstale":"2024-06-11T15:59:31.014861+0000","last_undegraded":"2024-06-11T15:59:31.014861+0000","last_fullsized":"2024-06-11T15:59:31.014861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:45:51.710605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314906+0000","last_change":"2024-06-11T15:58:59.204108+0000","last_active":"2024-06-11T15:59:30.314906+0000","last_peered":"2024-06-11T15:59:30.314906+0000","last_clean":"2024-06-11T15:59:30.314906+0000","last_became_active":"2024-06-11T15:58:59.203771+0000","last_became_peered":"2024-06-11T15:58:59.203771+0000","last_unstale":"2024-06-11T15:59:30.314906+0000","last_undegraded":"2024-06-11T15:59:30.314906+0000","last_fullsized":"2024-06-11T15:59:30.314906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312432+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T15:59:30.312432+0000","last_peered":"2024-06-11T15:59:30.312432+0000","last_clean":"2024-06-11T15:59:30.312432+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T15:59:30.312432+0000","last_undegraded":"2024-06-11T15:59:30.312432+0000","last_fullsized":"2024-06-11T15:59:30.312432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014356+0000","last_change":"2024-06-11T15:59:29.307032+0000","last_active":"2024-06-11T15:59:31.014356+0000","last_peered":"2024-06-11T15:59:31.014356+0000","last_clean":"2024-06-11T15:59:31.014356+0000","last_became_active":"2024-06-11T15:59:29.306817+0000","last_became_peered":"2024-06-11T15:59:29.306817+0000","last_unstale":"2024-06-11T15:59:31.014356+0000","last_undegraded":"2024-06-11T15:59:31.014356+0000","last_fullsized":"2024-06-11T15:59:31.014356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311822+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T15:59:30.311822+0000","last_peered":"2024-06-11T15:59:30.311822+0000","last_clean":"2024-06-11T15:59:30.311822+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T15:59:30.311822+0000","last_undegraded":"2024-06-11T15:59:30.311822+0000","last_fullsized":"2024-06-11T15:59:30.311822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014261+0000","last_change":"2024-06-11T15:58:59.206892+0000","last_active":"2024-06-11T15:59:31.014261+0000","last_peered":"2024-06-11T15:59:31.014261+0000","last_clean":"2024-06-11T15:59:31.014261+0000","last_became_active":"2024-06-11T15:58:59.205203+0000","last_became_peered":"2024-06-11T15:58:59.205203+0000","last_unstale":"2024-06-11T15:59:31.014261+0000","last_undegraded":"2024-06-11T15:59:31.014261+0000","last_fullsized":"2024-06-11T15:59:31.014261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312602+0000","last_change":"2024-06-11T15:59:29.307780+0000","last_active":"2024-06-11T15:59:30.312602+0000","last_peered":"2024-06-11T15:59:30.312602+0000","last_clean":"2024-06-11T15:59:30.312602+0000","last_became_active":"2024-06-11T15:59:29.307475+0000","last_became_peered":"2024-06-11T15:59:29.307475+0000","last_unstale":"2024-06-11T15:59:30.312602+0000","last_undegraded":"2024-06-11T15:59:30.312602+0000","last_fullsized":"2024-06-11T15:59:30.312602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:04.032746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014781+0000","last_change":"2024-06-11T15:58:58.184734+0000","last_active":"2024-06-11T15:59:31.014781+0000","last_peered":"2024-06-11T15:59:31.014781+0000","last_clean":"2024-06-11T15:59:31.014781+0000","last_became_active":"2024-06-11T15:58:58.184294+0000","last_became_peered":"2024-06-11T15:58:58.184294+0000","last_unstale":"2024-06-11T15:59:31.014781+0000","last_undegraded":"2024-06-11T15:59:31.014781+0000","last_fullsized":"2024-06-11T15:59:31.014781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312459+0000","last_change":"2024-06-11T15:59:29.308260+0000","last_active":"2024-06-11T15:59:30.312459+0000","last_peered":"2024-06-11T15:59:30.312459+0000","last_clean":"2024-06-11T15:59:30.312459+0000","last_became_active":"2024-06-11T15:59:29.307521+0000","last_became_peered":"2024-06-11T15:59:29.307521+0000","last_unstale":"2024-06-11T15:59:30.312459+0000","last_undegraded":"2024-06-11T15:59:30.312459+0000","last_fullsized":"2024-06-11T15:59:30.312459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:33.415958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312108+0000","last_change":"2024-06-11T15:58:58.177201+0000","last_active":"2024-06-11T15:59:30.312108+0000","last_peered":"2024-06-11T15:59:30.312108+0000","last_clean":"2024-06-11T15:59:30.312108+0000","last_became_active":"2024-06-11T15:58:58.176380+0000","last_became_peered":"2024-06-11T15:58:58.176380+0000","last_unstale":"2024-06-11T15:59:30.312108+0000","last_undegraded":"2024-06-11T15:59:30.312108+0000","last_fullsized":"2024-06-11T15:59:30.312108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:33:01.131637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312873+0000","last_change":"2024-06-11T15:58:59.200156+0000","last_active":"2024-06-11T15:59:30.312873+0000","last_peered":"2024-06-11T15:59:30.312873+0000","last_clean":"2024-06-11T15:59:30.312873+0000","last_became_active":"2024-06-11T15:58:59.199727+0000","last_became_peered":"2024-06-11T15:58:59.199727+0000","last_unstale":"2024-06-11T15:59:30.312873+0000","last_undegraded":"2024-06-11T15:59:30.312873+0000","last_fullsized":"2024-06-11T15:59:30.312873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:26.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314491+0000","last_change":"2024-06-11T15:58:58.179101+0000","last_active":"2024-06-11T15:59:30.314491+0000","last_peered":"2024-06-11T15:59:30.314491+0000","last_clean":"2024-06-11T15:59:30.314491+0000","last_became_active":"2024-06-11T15:58:58.178506+0000","last_became_peered":"2024-06-11T15:58:58.178506+0000","last_unstale":"2024-06-11T15:59:30.314491+0000","last_undegraded":"2024-06-11T15:59:30.314491+0000","last_fullsized":"2024-06-11T15:59:30.314491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:33.552424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312569+0000","last_change":"2024-06-11T15:58:59.200320+0000","last_active":"2024-06-11T15:59:30.312569+0000","last_peered":"2024-06-11T15:59:30.312569+0000","last_clean":"2024-06-11T15:59:30.312569+0000","last_became_active":"2024-06-11T15:58:59.199654+0000","last_became_peered":"2024-06-11T15:58:59.199654+0000","last_unstale":"2024-06-11T15:59:30.312569+0000","last_undegraded":"2024-06-11T15:59:30.312569+0000","last_fullsized":"2024-06-11T15:59:30.312569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:00.789663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014362+0000","last_change":"2024-06-11T15:58:58.179713+0000","last_active":"2024-06-11T15:59:31.014362+0000","last_peered":"2024-06-11T15:59:31.014362+0000","last_clean":"2024-06-11T15:59:31.014362+0000","last_became_active":"2024-06-11T15:58:58.179363+0000","last_became_peered":"2024-06-11T15:58:58.179363+0000","last_unstale":"2024-06-11T15:59:31.014362+0000","last_undegraded":"2024-06-11T15:59:31.014362+0000","last_fullsized":"2024-06-11T15:59:31.014362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015273+0000","last_change":"2024-06-11T15:58:58.180944+0000","last_active":"2024-06-11T15:59:31.015273+0000","last_peered":"2024-06-11T15:59:31.015273+0000","last_clean":"2024-06-11T15:59:31.015273+0000","last_became_active":"2024-06-11T15:58:58.180664+0000","last_became_peered":"2024-06-11T15:58:58.180664+0000","last_unstale":"2024-06-11T15:59:31.015273+0000","last_undegraded":"2024-06-11T15:59:31.015273+0000","last_fullsized":"2024-06-11T15:59:31.015273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014102+0000","last_change":"2024-06-11T15:59:29.307190+0000","last_active":"2024-06-11T15:59:31.014102+0000","last_peered":"2024-06-11T15:59:31.014102+0000","last_clean":"2024-06-11T15:59:31.014102+0000","last_became_active":"2024-06-11T15:59:29.306880+0000","last_became_peered":"2024-06-11T15:59:29.306880+0000","last_unstale":"2024-06-11T15:59:31.014102+0000","last_undegraded":"2024-06-11T15:59:31.014102+0000","last_fullsized":"2024-06-11T15:59:31.014102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:17:34.849327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.315057+0000","last_change":"2024-06-11T15:58:58.176711+0000","last_active":"2024-06-11T15:59:30.315057+0000","last_peered":"2024-06-11T15:59:30.315057+0000","last_clean":"2024-06-11T15:59:30.315057+0000","last_became_active":"2024-06-11T15:58:58.176389+0000","last_became_peered":"2024-06-11T15:58:58.176389+0000","last_unstale":"2024-06-11T15:59:30.315057+0000","last_undegraded":"2024-06-11T15:59:30.315057+0000","last_fullsized":"2024-06-11T15:59:30.315057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:14:51.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312015+0000","last_change":"2024-06-11T15:59:29.305115+0000","last_active":"2024-06-11T15:59:30.312015+0000","last_peered":"2024-06-11T15:59:30.312015+0000","last_clean":"2024-06-11T15:59:30.312015+0000","last_became_active":"2024-06-11T15:59:29.304789+0000","last_became_peered":"2024-06-11T15:59:29.304789+0000","last_unstale":"2024-06-11T15:59:30.312015+0000","last_undegraded":"2024-06-11T15:59:30.312015+0000","last_fullsized":"2024-06-11T15:59:30.312015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:08:21.411683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015144+0000","last_change":"2024-06-11T15:58:58.180996+0000","last_active":"2024-06-11T15:59:31.015144+0000","last_peered":"2024-06-11T15:59:31.015144+0000","last_clean":"2024-06-11T15:59:31.015144+0000","last_became_active":"2024-06-11T15:58:58.180693+0000","last_became_peered":"2024-06-11T15:58:58.180693+0000","last_unstale":"2024-06-11T15:59:31.015144+0000","last_undegraded":"2024-06-11T15:59:31.015144+0000","last_fullsized":"2024-06-11T15:59:31.015144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014535+0000","last_change":"2024-06-11T15:58:59.202891+0000","last_active":"2024-06-11T15:59:31.014535+0000","last_peered":"2024-06-11T15:59:31.014535+0000","last_clean":"2024-06-11T15:59:31.014535+0000","last_became_active":"2024-06-11T15:58:59.202169+0000","last_became_peered":"2024-06-11T15:58:59.202169+0000","last_unstale":"2024-06-11T15:59:31.014535+0000","last_undegraded":"2024-06-11T15:59:31.014535+0000","last_fullsized":"2024-06-11T15:59:31.014535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015112+0000","last_change":"2024-06-11T15:58:58.184768+0000","last_active":"2024-06-11T15:59:31.015112+0000","last_peered":"2024-06-11T15:59:31.015112+0000","last_clean":"2024-06-11T15:59:31.015112+0000","last_became_active":"2024-06-11T15:58:58.184405+0000","last_became_peered":"2024-06-11T15:58:58.184405+0000","last_unstale":"2024-06-11T15:59:31.015112+0000","last_undegraded":"2024-06-11T15:59:31.015112+0000","last_fullsized":"2024-06-11T15:59:31.015112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312500+0000","last_change":"2024-06-11T15:58:59.202459+0000","last_active":"2024-06-11T15:59:30.312500+0000","last_peered":"2024-06-11T15:59:30.312500+0000","last_clean":"2024-06-11T15:59:30.312500+0000","last_became_active":"2024-06-11T15:58:59.201927+0000","last_became_peered":"2024-06-11T15:58:59.201927+0000","last_unstale":"2024-06-11T15:59:30.312500+0000","last_undegraded":"2024-06-11T15:59:30.312500+0000","last_fullsized":"2024-06-11T15:59:30.312500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312641+0000","last_change":"2024-06-11T15:58:58.174994+0000","last_active":"2024-06-11T15:59:30.312641+0000","last_peered":"2024-06-11T15:59:30.312641+0000","last_clean":"2024-06-11T15:59:30.312641+0000","last_became_active":"2024-06-11T15:58:58.174572+0000","last_became_peered":"2024-06-11T15:58:58.174572+0000","last_unstale":"2024-06-11T15:59:30.312641+0000","last_undegraded":"2024-06-11T15:59:30.312641+0000","last_fullsized":"2024-06-11T15:59:30.312641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:06.111056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014936+0000","last_change":"2024-06-11T15:58:59.205652+0000","last_active":"2024-06-11T15:59:31.014936+0000","last_peered":"2024-06-11T15:59:31.014936+0000","last_clean":"2024-06-11T15:59:31.014936+0000","last_became_active":"2024-06-11T15:58:59.204942+0000","last_became_peered":"2024-06-11T15:58:59.204942+0000","last_unstale":"2024-06-11T15:59:31.014936+0000","last_undegraded":"2024-06-11T15:59:31.014936+0000","last_fullsized":"2024-06-11T15:59:31.014936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:26:31.920652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014888+0000","last_change":"2024-06-11T15:58:58.181650+0000","last_active":"2024-06-11T15:59:31.014888+0000","last_peered":"2024-06-11T15:59:31.014888+0000","last_clean":"2024-06-11T15:59:31.014888+0000","last_became_active":"2024-06-11T15:58:58.181437+0000","last_became_peered":"2024-06-11T15:58:58.181437+0000","last_unstale":"2024-06-11T15:59:31.014888+0000","last_undegraded":"2024-06-11T15:59:31.014888+0000","last_fullsized":"2024-06-11T15:59:31.014888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014999+0000","last_change":"2024-06-11T15:58:59.206156+0000","last_active":"2024-06-11T15:59:31.014999+0000","last_peered":"2024-06-11T15:59:31.014999+0000","last_clean":"2024-06-11T15:59:31.014999+0000","last_became_active":"2024-06-11T15:58:59.204911+0000","last_became_peered":"2024-06-11T15:58:59.204911+0000","last_unstale":"2024-06-11T15:59:31.014999+0000","last_undegraded":"2024-06-11T15:59:31.014999+0000","last_fullsized":"2024-06-11T15:59:31.014999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:18:42.958885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014243+0000","last_change":"2024-06-11T15:59:29.307115+0000","last_active":"2024-06-11T15:59:31.014243+0000","last_peered":"2024-06-11T15:59:31.014243+0000","last_clean":"2024-06-11T15:59:31.014243+0000","last_became_active":"2024-06-11T15:59:29.306843+0000","last_became_peered":"2024-06-11T15:59:29.306843+0000","last_unstale":"2024-06-11T15:59:31.014243+0000","last_undegraded":"2024-06-11T15:59:31.014243+0000","last_fullsized":"2024-06-11T15:59:31.014243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.685489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014874+0000","last_change":"2024-06-11T15:58:59.201577+0000","last_active":"2024-06-11T15:59:31.014874+0000","last_peered":"2024-06-11T15:59:31.014874+0000","last_clean":"2024-06-11T15:59:31.014874+0000","last_became_active":"2024-06-11T15:58:59.201220+0000","last_became_peered":"2024-06-11T15:58:59.201220+0000","last_unstale":"2024-06-11T15:59:31.014874+0000","last_undegraded":"2024-06-11T15:59:31.014874+0000","last_fullsized":"2024-06-11T15:59:31.014874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314464+0000","last_change":"2024-06-11T15:58:58.181496+0000","last_active":"2024-06-11T15:59:30.314464+0000","last_peered":"2024-06-11T15:59:30.314464+0000","last_clean":"2024-06-11T15:59:30.314464+0000","last_became_active":"2024-06-11T15:58:58.181243+0000","last_became_peered":"2024-06-11T15:58:58.181243+0000","last_unstale":"2024-06-11T15:59:30.314464+0000","last_undegraded":"2024-06-11T15:59:30.314464+0000","last_fullsized":"2024-06-11T15:59:30.314464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:36:23.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312800+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T15:59:30.312800+0000","last_peered":"2024-06-11T15:59:30.312800+0000","last_clean":"2024-06-11T15:59:30.312800+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T15:59:30.312800+0000","last_undegraded":"2024-06-11T15:59:30.312800+0000","last_fullsized":"2024-06-11T15:59:30.312800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014592+0000","last_change":"2024-06-11T15:58:52.148089+0000","last_active":"2024-06-11T15:59:31.014592+0000","last_peered":"2024-06-11T15:59:31.014592+0000","last_clean":"2024-06-11T15:59:31.014592+0000","last_became_active":"2024-06-11T15:58:52.147163+0000","last_became_peered":"2024-06-11T15:58:52.147163+0000","last_unstale":"2024-06-11T15:59:31.014592+0000","last_undegraded":"2024-06-11T15:59:31.014592+0000","last_fullsized":"2024-06-11T15:59:31.014592+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:34:52.351077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014879+0000","last_change":"2024-06-11T15:58:56.168931+0000","last_active":"2024-06-11T15:59:31.014879+0000","last_peered":"2024-06-11T15:59:31.014879+0000","last_clean":"2024-06-11T15:59:31.014879+0000","last_became_active":"2024-06-11T15:58:56.168554+0000","last_became_peered":"2024-06-11T15:58:56.168554+0000","last_unstale":"2024-06-11T15:59:31.014879+0000","last_undegraded":"2024-06-11T15:59:31.014879+0000","last_fullsized":"2024-06-11T15:59:31.014879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312233+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T15:59:30.312233+0000","last_peered":"2024-06-11T15:59:30.312233+0000","last_clean":"2024-06-11T15:59:30.312233+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T15:59:30.312233+0000","last_undegraded":"2024-06-11T15:59:30.312233+0000","last_fullsized":"2024-06-11T15:59:30.312233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015046+0000","last_change":"2024-06-11T15:58:59.205934+0000","last_active":"2024-06-11T15:59:31.015046+0000","last_peered":"2024-06-11T15:59:31.015046+0000","last_clean":"2024-06-11T15:59:31.015046+0000","last_became_active":"2024-06-11T15:58:59.204720+0000","last_became_peered":"2024-06-11T15:58:59.204720+0000","last_unstale":"2024-06-11T15:59:31.015046+0000","last_undegraded":"2024-06-11T15:59:31.015046+0000","last_fullsized":"2024-06-11T15:59:31.015046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:01.900508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014504+0000","last_change":"2024-06-11T15:58:56.167051+0000","last_active":"2024-06-11T15:59:31.014504+0000","last_peered":"2024-06-11T15:59:31.014504+0000","last_clean":"2024-06-11T15:59:31.014504+0000","last_became_active":"2024-06-11T15:58:56.166834+0000","last_became_peered":"2024-06-11T15:58:56.166834+0000","last_unstale":"2024-06-11T15:59:31.014504+0000","last_undegraded":"2024-06-11T15:59:31.014504+0000","last_fullsized":"2024-06-11T15:59:31.014504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:19.296135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312186+0000","last_change":"2024-06-11T15:58:58.174932+0000","last_active":"2024-06-11T15:59:30.312186+0000","last_peered":"2024-06-11T15:59:30.312186+0000","last_clean":"2024-06-11T15:59:30.312186+0000","last_became_active":"2024-06-11T15:58:58.174474+0000","last_became_peered":"2024-06-11T15:58:58.174474+0000","last_unstale":"2024-06-11T15:59:30.312186+0000","last_undegraded":"2024-06-11T15:59:30.312186+0000","last_fullsized":"2024-06-11T15:59:30.312186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312598+0000","last_change":"2024-06-11T15:59:29.308305+0000","last_active":"2024-06-11T15:59:30.312598+0000","last_peered":"2024-06-11T15:59:30.312598+0000","last_clean":"2024-06-11T15:59:30.312598+0000","last_became_active":"2024-06-11T15:59:29.307739+0000","last_became_peered":"2024-06-11T15:59:29.307739+0000","last_unstale":"2024-06-11T15:59:30.312598+0000","last_undegraded":"2024-06-11T15:59:30.312598+0000","last_fullsized":"2024-06-11T15:59:30.312598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:37.529774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312293+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T15:59:30.312293+0000","last_peered":"2024-06-11T15:59:30.312293+0000","last_clean":"2024-06-11T15:59:30.312293+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T15:59:30.312293+0000","last_undegraded":"2024-06-11T15:59:30.312293+0000","last_fullsized":"2024-06-11T15:59:30.312293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014091+0000","last_change":"2024-06-11T15:59:29.307829+0000","last_active":"2024-06-11T15:59:31.014091+0000","last_peered":"2024-06-11T15:59:31.014091+0000","last_clean":"2024-06-11T15:59:31.014091+0000","last_became_active":"2024-06-11T15:59:29.307536+0000","last_became_peered":"2024-06-11T15:59:29.307536+0000","last_unstale":"2024-06-11T15:59:31.014091+0000","last_undegraded":"2024-06-11T15:59:31.014091+0000","last_fullsized":"2024-06-11T15:59:31.014091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:05:41.543760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312800+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T15:59:30.312800+0000","last_peered":"2024-06-11T15:59:30.312800+0000","last_clean":"2024-06-11T15:59:30.312800+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T15:59:30.312800+0000","last_undegraded":"2024-06-11T15:59:30.312800+0000","last_fullsized":"2024-06-11T15:59:30.312800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014926+0000","last_change":"2024-06-11T15:58:56.169010+0000","last_active":"2024-06-11T15:59:31.014926+0000","last_peered":"2024-06-11T15:59:31.014926+0000","last_clean":"2024-06-11T15:59:31.014926+0000","last_became_active":"2024-06-11T15:58:56.168597+0000","last_became_peered":"2024-06-11T15:58:56.168597+0000","last_unstale":"2024-06-11T15:59:31.014926+0000","last_undegraded":"2024-06-11T15:59:31.014926+0000","last_fullsized":"2024-06-11T15:59:31.014926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:55:10.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014834+0000","last_change":"2024-06-11T15:58:58.184632+0000","last_active":"2024-06-11T15:59:31.014834+0000","last_peered":"2024-06-11T15:59:31.014834+0000","last_clean":"2024-06-11T15:59:31.014834+0000","last_became_active":"2024-06-11T15:58:58.184201+0000","last_became_peered":"2024-06-11T15:58:58.184201+0000","last_unstale":"2024-06-11T15:59:31.014834+0000","last_undegraded":"2024-06-11T15:59:31.014834+0000","last_fullsized":"2024-06-11T15:59:31.014834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:10:28.789226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312655+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T15:59:30.312655+0000","last_peered":"2024-06-11T15:59:30.312655+0000","last_clean":"2024-06-11T15:59:30.312655+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T15:59:30.312655+0000","last_undegraded":"2024-06-11T15:59:30.312655+0000","last_fullsized":"2024-06-11T15:59:30.312655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015203+0000","last_change":"2024-06-11T15:58:58.184856+0000","last_active":"2024-06-11T15:59:31.015203+0000","last_peered":"2024-06-11T15:59:31.015203+0000","last_clean":"2024-06-11T15:59:31.015203+0000","last_became_active":"2024-06-11T15:58:58.184497+0000","last_became_peered":"2024-06-11T15:58:58.184497+0000","last_unstale":"2024-06-11T15:59:31.015203+0000","last_undegraded":"2024-06-11T15:59:31.015203+0000","last_fullsized":"2024-06-11T15:59:31.015203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:16.829752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312751+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T15:59:30.312751+0000","last_peered":"2024-06-11T15:59:30.312751+0000","last_clean":"2024-06-11T15:59:30.312751+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T15:59:30.312751+0000","last_undegraded":"2024-06-11T15:59:30.312751+0000","last_fullsized":"2024-06-11T15:59:30.312751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314583+0000","last_change":"2024-06-11T15:58:59.203806+0000","last_active":"2024-06-11T15:59:30.314583+0000","last_peered":"2024-06-11T15:59:30.314583+0000","last_clean":"2024-06-11T15:59:30.314583+0000","last_became_active":"2024-06-11T15:58:59.203045+0000","last_became_peered":"2024-06-11T15:58:59.203045+0000","last_unstale":"2024-06-11T15:59:30.314583+0000","last_undegraded":"2024-06-11T15:59:30.314583+0000","last_fullsized":"2024-06-11T15:59:30.314583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312688+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T15:59:30.312688+0000","last_peered":"2024-06-11T15:59:30.312688+0000","last_clean":"2024-06-11T15:59:30.312688+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T15:59:30.312688+0000","last_undegraded":"2024-06-11T15:59:30.312688+0000","last_fullsized":"2024-06-11T15:59:30.312688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312618+0000","last_change":"2024-06-11T15:59:29.308481+0000","last_active":"2024-06-11T15:59:30.312618+0000","last_peered":"2024-06-11T15:59:30.312618+0000","last_clean":"2024-06-11T15:59:30.312618+0000","last_became_active":"2024-06-11T15:59:29.307986+0000","last_became_peered":"2024-06-11T15:59:29.307986+0000","last_unstale":"2024-06-11T15:59:30.312618+0000","last_undegraded":"2024-06-11T15:59:30.312618+0000","last_fullsized":"2024-06-11T15:59:30.312618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:20.285064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014408+0000","last_change":"2024-06-11T15:59:29.307154+0000","last_active":"2024-06-11T15:59:31.014408+0000","last_peered":"2024-06-11T15:59:31.014408+0000","last_clean":"2024-06-11T15:59:31.014408+0000","last_became_active":"2024-06-11T15:59:29.306883+0000","last_became_peered":"2024-06-11T15:59:29.306883+0000","last_unstale":"2024-06-11T15:59:31.014408+0000","last_undegraded":"2024-06-11T15:59:31.014408+0000","last_fullsized":"2024-06-11T15:59:31.014408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:23.293712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.313120+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T15:59:30.313120+0000","last_peered":"2024-06-11T15:59:30.313120+0000","last_clean":"2024-06-11T15:59:30.313120+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T15:59:30.313120+0000","last_undegraded":"2024-06-11T15:59:30.313120+0000","last_fullsized":"2024-06-11T15:59:30.313120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312981+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T15:59:30.312981+0000","last_peered":"2024-06-11T15:59:30.312981+0000","last_clean":"2024-06-11T15:59:30.312981+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T15:59:30.312981+0000","last_undegraded":"2024-06-11T15:59:30.312981+0000","last_fullsized":"2024-06-11T15:59:30.312981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312008+0000","last_change":"2024-06-11T15:58:59.205035+0000","last_active":"2024-06-11T15:59:30.312008+0000","last_peered":"2024-06-11T15:59:30.312008+0000","last_clean":"2024-06-11T15:59:30.312008+0000","last_became_active":"2024-06-11T15:58:59.204727+0000","last_became_peered":"2024-06-11T15:58:59.204727+0000","last_unstale":"2024-06-11T15:59:30.312008+0000","last_undegraded":"2024-06-11T15:59:30.312008+0000","last_fullsized":"2024-06-11T15:59:30.312008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:04.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312905+0000","last_change":"2024-06-11T15:58:58.175106+0000","last_active":"2024-06-11T15:59:30.312905+0000","last_peered":"2024-06-11T15:59:30.312905+0000","last_clean":"2024-06-11T15:59:30.312905+0000","last_became_active":"2024-06-11T15:58:58.174630+0000","last_became_peered":"2024-06-11T15:58:58.174630+0000","last_unstale":"2024-06-11T15:59:30.312905+0000","last_undegraded":"2024-06-11T15:59:30.312905+0000","last_fullsized":"2024-06-11T15:59:30.312905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015277+0000","last_change":"2024-06-11T15:58:56.168907+0000","last_active":"2024-06-11T15:59:31.015277+0000","last_peered":"2024-06-11T15:59:31.015277+0000","last_clean":"2024-06-11T15:59:31.015277+0000","last_became_active":"2024-06-11T15:58:56.168562+0000","last_became_peered":"2024-06-11T15:58:56.168562+0000","last_unstale":"2024-06-11T15:59:31.015277+0000","last_undegraded":"2024-06-11T15:59:31.015277+0000","last_fullsized":"2024-06-11T15:59:31.015277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:03:29.648718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314465+0000","last_change":"2024-06-11T15:58:59.203649+0000","last_active":"2024-06-11T15:59:30.314465+0000","last_peered":"2024-06-11T15:59:30.314465+0000","last_clean":"2024-06-11T15:59:30.314465+0000","last_became_active":"2024-06-11T15:58:59.203164+0000","last_became_peered":"2024-06-11T15:58:59.203164+0000","last_unstale":"2024-06-11T15:59:30.314465+0000","last_undegraded":"2024-06-11T15:59:30.314465+0000","last_fullsized":"2024-06-11T15:59:30.314465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:23:17.667792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014572+0000","last_change":"2024-06-11T15:58:59.201939+0000","last_active":"2024-06-11T15:59:31.014572+0000","last_peered":"2024-06-11T15:59:31.014572+0000","last_clean":"2024-06-11T15:59:31.014572+0000","last_became_active":"2024-06-11T15:58:59.200992+0000","last_became_peered":"2024-06-11T15:58:59.200992+0000","last_unstale":"2024-06-11T15:59:31.014572+0000","last_undegraded":"2024-06-11T15:59:31.014572+0000","last_fullsized":"2024-06-11T15:59:31.014572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:57:09.221317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"22'10","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015039+0000","last_change":"2024-06-11T15:58:58.181087+0000","last_active":"2024-06-11T15:59:31.015039+0000","last_peered":"2024-06-11T15:59:31.015039+0000","last_clean":"2024-06-11T15:59:31.015039+0000","last_became_active":"2024-06-11T15:58:58.180756+0000","last_became_peered":"2024-06-11T15:58:58.180756+0000","last_unstale":"2024-06-11T15:59:31.015039+0000","last_undegraded":"2024-06-11T15:59:31.015039+0000","last_fullsized":"2024-06-11T15:59:31.015039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:55:23.475622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311989+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T15:59:30.311989+0000","last_peered":"2024-06-11T15:59:30.311989+0000","last_clean":"2024-06-11T15:59:30.311989+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T15:59:30.311989+0000","last_undegraded":"2024-06-11T15:59:30.311989+0000","last_fullsized":"2024-06-11T15:59:30.311989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.315029+0000","last_change":"2024-06-11T15:58:58.178983+0000","last_active":"2024-06-11T15:59:30.315029+0000","last_peered":"2024-06-11T15:59:30.315029+0000","last_clean":"2024-06-11T15:59:30.315029+0000","last_became_active":"2024-06-11T15:58:58.178610+0000","last_became_peered":"2024-06-11T15:58:58.178610+0000","last_unstale":"2024-06-11T15:59:30.315029+0000","last_undegraded":"2024-06-11T15:59:30.315029+0000","last_fullsized":"2024-06-11T15:59:30.315029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:28:23.616470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015197+0000","last_change":"2024-06-11T15:58:58.184765+0000","last_active":"2024-06-11T15:59:31.015197+0000","last_peered":"2024-06-11T15:59:31.015197+0000","last_clean":"2024-06-11T15:59:31.015197+0000","last_became_active":"2024-06-11T15:58:58.184365+0000","last_became_peered":"2024-06-11T15:58:58.184365+0000","last_unstale":"2024-06-11T15:59:31.015197+0000","last_undegraded":"2024-06-11T15:59:31.015197+0000","last_fullsized":"2024-06-11T15:59:31.015197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311901+0000","last_change":"2024-06-11T15:58:59.200566+0000","last_active":"2024-06-11T15:59:30.311901+0000","last_peered":"2024-06-11T15:59:30.311901+0000","last_clean":"2024-06-11T15:59:30.311901+0000","last_became_active":"2024-06-11T15:58:59.199973+0000","last_became_peered":"2024-06-11T15:58:59.199973+0000","last_unstale":"2024-06-11T15:59:30.311901+0000","last_undegraded":"2024-06-11T15:59:30.311901+0000","last_fullsized":"2024-06-11T15:59:30.311901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:51:45.713198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.313023+0000","last_change":"2024-06-11T15:58:58.175038+0000","last_active":"2024-06-11T15:59:30.313023+0000","last_peered":"2024-06-11T15:59:30.313023+0000","last_clean":"2024-06-11T15:59:30.313023+0000","last_became_active":"2024-06-11T15:58:58.174680+0000","last_became_peered":"2024-06-11T15:58:58.174680+0000","last_unstale":"2024-06-11T15:59:30.313023+0000","last_undegraded":"2024-06-11T15:59:30.313023+0000","last_fullsized":"2024-06-11T15:59:30.313023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:41:37.615837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311964+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T15:59:30.311964+0000","last_peered":"2024-06-11T15:59:30.311964+0000","last_clean":"2024-06-11T15:59:30.311964+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T15:59:30.311964+0000","last_undegraded":"2024-06-11T15:59:30.311964+0000","last_fullsized":"2024-06-11T15:59:30.311964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.015140+0000","last_change":"2024-06-11T15:59:29.307143+0000","last_active":"2024-06-11T15:59:31.015140+0000","last_peered":"2024-06-11T15:59:31.015140+0000","last_clean":"2024-06-11T15:59:31.015140+0000","last_became_active":"2024-06-11T15:59:29.306864+0000","last_became_peered":"2024-06-11T15:59:29.306864+0000","last_unstale":"2024-06-11T15:59:31.015140+0000","last_undegraded":"2024-06-11T15:59:31.015140+0000","last_fullsized":"2024-06-11T15:59:31.015140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312123+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T15:59:30.312123+0000","last_peered":"2024-06-11T15:59:30.312123+0000","last_clean":"2024-06-11T15:59:30.312123+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T15:59:30.312123+0000","last_undegraded":"2024-06-11T15:59:30.312123+0000","last_fullsized":"2024-06-11T15:59:30.312123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312719+0000","last_change":"2024-06-11T15:58:59.202401+0000","last_active":"2024-06-11T15:59:30.312719+0000","last_peered":"2024-06-11T15:59:30.312719+0000","last_clean":"2024-06-11T15:59:30.312719+0000","last_became_active":"2024-06-11T15:58:59.201880+0000","last_became_peered":"2024-06-11T15:58:59.201880+0000","last_unstale":"2024-06-11T15:59:30.312719+0000","last_undegraded":"2024-06-11T15:59:30.312719+0000","last_fullsized":"2024-06-11T15:59:30.312719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:19.029133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312070+0000","last_change":"2024-06-11T15:58:58.175737+0000","last_active":"2024-06-11T15:59:30.312070+0000","last_peered":"2024-06-11T15:59:30.312070+0000","last_clean":"2024-06-11T15:59:30.312070+0000","last_became_active":"2024-06-11T15:58:58.174923+0000","last_became_peered":"2024-06-11T15:58:58.174923+0000","last_unstale":"2024-06-11T15:59:30.312070+0000","last_undegraded":"2024-06-11T15:59:30.312070+0000","last_fullsized":"2024-06-11T15:59:30.312070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314860+0000","last_change":"2024-06-11T15:58:59.203186+0000","last_active":"2024-06-11T15:59:30.314860+0000","last_peered":"2024-06-11T15:59:30.314860+0000","last_clean":"2024-06-11T15:59:30.314860+0000","last_became_active":"2024-06-11T15:58:59.202811+0000","last_became_peered":"2024-06-11T15:58:59.202811+0000","last_unstale":"2024-06-11T15:59:30.314860+0000","last_undegraded":"2024-06-11T15:59:30.314860+0000","last_fullsized":"2024-06-11T15:59:30.314860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:20:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.311933+0000","last_change":"2024-06-11T15:59:29.305122+0000","last_active":"2024-06-11T15:59:30.311933+0000","last_peered":"2024-06-11T15:59:30.311933+0000","last_clean":"2024-06-11T15:59:30.311933+0000","last_became_active":"2024-06-11T15:59:29.304793+0000","last_became_peered":"2024-06-11T15:59:29.304793+0000","last_unstale":"2024-06-11T15:59:30.311933+0000","last_undegraded":"2024-06-11T15:59:30.311933+0000","last_fullsized":"2024-06-11T15:59:30.311933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:30:40.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312390+0000","last_change":"2024-06-11T15:59:29.308065+0000","last_active":"2024-06-11T15:59:30.312390+0000","last_peered":"2024-06-11T15:59:30.312390+0000","last_clean":"2024-06-11T15:59:30.312390+0000","last_became_active":"2024-06-11T15:59:29.307541+0000","last_became_peered":"2024-06-11T15:59:29.307541+0000","last_unstale":"2024-06-11T15:59:30.312390+0000","last_undegraded":"2024-06-11T15:59:30.312390+0000","last_fullsized":"2024-06-11T15:59:30.312390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:01:30.960914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.314728+0000","last_change":"2024-06-11T15:58:58.178451+0000","last_active":"2024-06-11T15:59:30.314728+0000","last_peered":"2024-06-11T15:59:30.314728+0000","last_clean":"2024-06-11T15:59:30.314728+0000","last_became_active":"2024-06-11T15:58:58.177761+0000","last_became_peered":"2024-06-11T15:58:58.177761+0000","last_unstale":"2024-06-11T15:59:30.314728+0000","last_undegraded":"2024-06-11T15:59:30.314728+0000","last_fullsized":"2024-06-11T15:59:30.314728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:42:49.541558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014585+0000","last_change":"2024-06-11T15:58:59.203089+0000","last_active":"2024-06-11T15:59:31.014585+0000","last_peered":"2024-06-11T15:59:31.014585+0000","last_clean":"2024-06-11T15:59:31.014585+0000","last_became_active":"2024-06-11T15:58:59.202532+0000","last_became_peered":"2024-06-11T15:58:59.202532+0000","last_unstale":"2024-06-11T15:59:31.014585+0000","last_undegraded":"2024-06-11T15:59:31.014585+0000","last_fullsized":"2024-06-11T15:59:31.014585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:09.142393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014990+0000","last_change":"2024-06-11T15:58:58.184783+0000","last_active":"2024-06-11T15:59:31.014990+0000","last_peered":"2024-06-11T15:59:31.014990+0000","last_clean":"2024-06-11T15:59:31.014990+0000","last_became_active":"2024-06-11T15:58:58.184406+0000","last_became_peered":"2024-06-11T15:58:58.184406+0000","last_unstale":"2024-06-11T15:59:31.014990+0000","last_undegraded":"2024-06-11T15:59:31.014990+0000","last_fullsized":"2024-06-11T15:59:31.014990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:36.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014641+0000","last_change":"2024-06-11T15:58:59.204339+0000","last_active":"2024-06-11T15:59:31.014641+0000","last_peered":"2024-06-11T15:59:31.014641+0000","last_clean":"2024-06-11T15:59:31.014641+0000","last_became_active":"2024-06-11T15:58:59.203665+0000","last_became_peered":"2024-06-11T15:58:59.203665+0000","last_unstale":"2024-06-11T15:59:31.014641+0000","last_undegraded":"2024-06-11T15:59:31.014641+0000","last_fullsized":"2024-06-11T15:59:31.014641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:10.610402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014639+0000","last_change":"2024-06-11T15:59:29.307817+0000","last_active":"2024-06-11T15:59:31.014639+0000","last_peered":"2024-06-11T15:59:31.014639+0000","last_clean":"2024-06-11T15:59:31.014639+0000","last_became_active":"2024-06-11T15:59:29.307525+0000","last_became_peered":"2024-06-11T15:59:29.307525+0000","last_unstale":"2024-06-11T15:59:31.014639+0000","last_undegraded":"2024-06-11T15:59:31.014639+0000","last_fullsized":"2024-06-11T15:59:31.014639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:39:16.276410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312350+0000","last_change":"2024-06-11T15:59:29.308075+0000","last_active":"2024-06-11T15:59:30.312350+0000","last_peered":"2024-06-11T15:59:30.312350+0000","last_clean":"2024-06-11T15:59:30.312350+0000","last_became_active":"2024-06-11T15:59:29.307570+0000","last_became_peered":"2024-06-11T15:59:29.307570+0000","last_unstale":"2024-06-11T15:59:30.312350+0000","last_undegraded":"2024-06-11T15:59:30.312350+0000","last_fullsized":"2024-06-11T15:59:30.312350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:41.270065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312830+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T15:59:30.312830+0000","last_peered":"2024-06-11T15:59:30.312830+0000","last_clean":"2024-06-11T15:59:30.312830+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T15:59:30.312830+0000","last_undegraded":"2024-06-11T15:59:30.312830+0000","last_fullsized":"2024-06-11T15:59:30.312830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:31.014483+0000","last_change":"2024-06-11T15:58:59.206551+0000","last_active":"2024-06-11T15:59:31.014483+0000","last_peered":"2024-06-11T15:59:31.014483+0000","last_clean":"2024-06-11T15:59:31.014483+0000","last_became_active":"2024-06-11T15:58:59.204679+0000","last_became_peered":"2024-06-11T15:58:59.204679+0000","last_unstale":"2024-06-11T15:59:31.014483+0000","last_undegraded":"2024-06-11T15:59:31.014483+0000","last_fullsized":"2024-06-11T15:59:31.014483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:41:02.170999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-06-11T15:59:30.312918+0000","last_change":"2024-06-11T15:58:58.177254+0000","last_active":"2024-06-11T15:59:30.312918+0000","last_peered":"2024-06-11T15:59:30.312918+0000","last_clean":"2024-06-11T15:59:30.312918+0000","last_became_active":"2024-06-11T15:58:58.176277+0000","last_became_peered":"2024-06-11T15:58:58.176277+0000","last_unstale":"2024-06-11T15:59:30.312918+0000","last_undegraded":"2024-06-11T15:59:30.312918+0000","last_fullsized":"2024-06-11T15:59:30.312918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:05:54.350060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7350,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":19944,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":684642,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":307200,"data_stored":684026,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":87540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T15:59:34.251 INFO:tasks.thrashosds.thrasher:Setting 4.2d to [0, 1] 2024-06-11T15:59:34.252 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.2d', '0', '1'] 2024-06-11T15:59:34.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.2d 0 1 2024-06-11T15:59:34.252 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:34.216+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 43.141871610000003, 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.278 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:34.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:34.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.284 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.093168820999999, 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.285 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:34.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:34.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.291 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.796601103, 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.292 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:34.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:34.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.796550949, 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.298 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.299 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:34.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.303 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.796536283000002, 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.304 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:34.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.664743971999997, 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.310 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:34.313 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.664716732000002, 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.316 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.317 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:34.318 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.319 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:34.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.321 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.322 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.664692535, 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.323 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:34.324 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.325 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:34.326 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.327 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.328 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.664618623999999, 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.329 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.331 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.332 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:34.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.334 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.458614371000003, 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.335 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.336 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:34.337 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.338 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:34.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.340 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:34.341 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 41.458534415999999, 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.342 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:34.343 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:34.344 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.345 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.352 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:34.353 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080694864000002, 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.354 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:34.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.356 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.357 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:34.358 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.359 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080660242, 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.360 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.361 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:34.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:34.363 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.364 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080629672000001, 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.365 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.366 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.367 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:34.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.369 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.370 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080604295000001, 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:34.371 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.372 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.373 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.374 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080579774, 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.376 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.377 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.378 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:34.379 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:34.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.381 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080556285, 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.383 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:34.384 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.385 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.386 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:34.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:34.388 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080355404000002, 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.389 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.390 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:34.391 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.392 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.393 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:34.394 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.395 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080278272999998, 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.396 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.397 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.398 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.399 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.400 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:34.401 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 35.080096177000001, 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:34.402 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:34.403 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:34.404 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:34.405 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:34.406 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:34.408 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:34.408 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:34.408+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:34.508 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:34.508+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:34.524 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:34.524 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:34.524 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:34.524 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:34.533 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:34.609 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:34.610+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:34.678 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:34.679 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:34.679 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:34.679 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:34.679 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:34.688 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:34.732 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:34.733+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:34.793 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.597103789999998, 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.794 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:34.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596946799999998, 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:34.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:34.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.806 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596906390999997, 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:34.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:34.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596832671999998, 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:34.813 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596695212, 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596661408999999, 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.830 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596356614000001, 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.832 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.834 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596274352999998, 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:34.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:34.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.596232831000002, 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.839 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.595280924999997, 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:34.843 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:34.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.847 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.595214048999999, 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:34.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.594898497000003, 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.852 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:34.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.594353349000002, 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.856 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:34.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:34.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.594013390000001, 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:34.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:34.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:34.865 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.591897091, 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.591496681000002, 2024-06-11T15:59:34.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:34.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 33.598342834999997, 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:34.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:34.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.596360108000001, 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:34.879 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:34.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:34.884 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 14.594838020999999, 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:34.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:34.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.5954411109999995, 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:34.889 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:34.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:34.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.894 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.895 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.895 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:34.895 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:34.895 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:34.896 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:34.897 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:34.897+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:34.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:34.998+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:35.014 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:35.014 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:35.014 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:35.014 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:35.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:35.098 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:35.099+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:35.170 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:35.170 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:35.170 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:35.170 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:35.171 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:35.179 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:35.199 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:35.200+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:35.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:35.285 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.802601324999998, 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.286 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:35.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.802040062000003, 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:35.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:35.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:35.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:35.295 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.799774036000002, 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:35.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.300 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.799219827000002, 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:35.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.792010943999998, 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.305 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.791583909000003, 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 42.333603816999997, 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:35.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:35.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.088151912000001, 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:35.321 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:35.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:35.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:35.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.088036643000002, 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.327 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:35.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:35.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.088004841999997, 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:35.333 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:35.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:35.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:35.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.087948077999997, 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.339 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:35.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:35.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.087921575999999, 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.087892529000001, 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:35.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:35.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.087841470999997, 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.087789837999999, 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.081607751999996, 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.077286245000003, 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.077110431000001, 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.077042282000001, 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.076982739999998, 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:35.390 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:35.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T15:59:35.393 INFO:teuthology.orchestra.run.smithi089.stderr:set 4.2d pg_upmap mapping to [0,1] 2024-06-11T15:59:35.393 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:35.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:35.392+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:35.396 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:35.396 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:35.417 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:35.417 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:35.435 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:35.435 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:35.492 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:35.493+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:35.512 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:35.512 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:35.522 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:35.593 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:35.594+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:35.628 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:35.628 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:35.636 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:35.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:35.696+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:35.781 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:35.782 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:35.790 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:35.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:35.797+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:35.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:35.897+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:35.907 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:35.907 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:35.916 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:35.998 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:35.998+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:36.022 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.022 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.031 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:36.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.099+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.136 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.136 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.146 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:36.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.200+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.262 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.262 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:36.301 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:36.301+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:36.338 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T15:59:36.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.402+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.417 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.417 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:36.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.510+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.570 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.570 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.579 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:36.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.621+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.690 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.690 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.699 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:36.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.706+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.804 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.804 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:36.806+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:36.812 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:36.906 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:36.907+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:36.917 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:36.917 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:36.926 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:37.007 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:37.008+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:37.043 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:37.044 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:37.053 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:37.107 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:37.108+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:37.200 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:37.200 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:37.209 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:37.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:37.209+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:37.309 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:37.309+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:37.314 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:37.314 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:37.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:37.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:37.411+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:37.432 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:37.432 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:37.441 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:37.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:37.511 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:37.511+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:37.571 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:37.572 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:37.588 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:37.588 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:37.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:37.593 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:37.597 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:37.611 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:37.611 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:37.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:37.641+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:37.703 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:37.703 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.220396907999998, 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:37.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:37.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:37.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.219835645000003, 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.709 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:37.713 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.217569619000002, 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.217015410000002, 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.209806526999998, 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:37.722 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:37.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.209379491999997, 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.727 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:37.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 44.751399399999997, 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.736 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505947495000001, 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:37.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:37.742 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505832226000003, 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.743 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:37.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:37.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:37.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505800424999997, 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:37.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:37.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505743660999997, 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.757 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:37.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505717159, 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:37.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:37.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:37.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.771 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505688112000001, 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:37.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:37.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:37.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.776 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505637053999997, 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.781 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.505585420999999, 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.499403334999997, 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:37.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:37.790 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.495081827999996, 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:37.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.494906014000001, 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:37.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:37.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:37.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.494837865000001, 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:37.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:37.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:37.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:37.806 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.494778322999998, 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:37.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:37.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:37.810 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:37.811 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:37.812 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:37.812 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:37.812+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:37.913 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:37.913+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:37.928 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:37.928 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:37.928 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:37.929 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:37.937 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:38.013 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:38.014+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:38.084 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:38.084 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:38.084 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:38.084 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:38.084 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:38.094 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:38.114 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:38.114+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:38.201 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:38.201 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.065492218999999, 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.202 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:38.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:38.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 46.016789430000003, 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.209 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:38.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:38.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.720221711999997, 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.215 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.216 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:38.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.720171557999997, 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.221 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:38.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:38.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.720156891999999, 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.227 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:38.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:38.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:38.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:38.233 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.588364581, 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:38.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.588337340999999, 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:38.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.245 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.588313143999997, 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.246 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:38.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:38.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.588239233000003, 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.254 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.255 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.256 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.38223498, 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.257 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.258 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.259 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.260 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.261 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.262 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 45.382155025000003, 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.263 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.265 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:38.266 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.267 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004315472999998, 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.268 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:38.269 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.270 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.271 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.272 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.273 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004280850999997, 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:38.274 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:38.275 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.276 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.277 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:38.278 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004250280999997, 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.279 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.280 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.282 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.283 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.284 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004224903999997, 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.285 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:38.286 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:38.287 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:38.288 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:38.289 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004200382999997, 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.290 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.291 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:38.292 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:38.293 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.294 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.295 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.004176893999997, 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.296 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.297 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:38.298 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.299 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.300 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:38.301 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.003976012999999, 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.302 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.304 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.305 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.306 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.003898882000001, 2024-06-11T15:59:38.307 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:38.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.310 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.311 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:38.312 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 39.003716785999998, 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.313 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.314 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:38.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:38.316 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:38.317 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:38.318 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:38.319+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:38.319 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:38.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T15:59:38.419 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:38.420+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:38.436 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:38.436 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:38.436 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:38.436 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:38.445 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:38.519 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:38.520+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:38.590 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:38.590 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:38.590 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:38.590 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:38.591 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:38.599 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:38.642 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:38.643+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508586045000001, 2024-06-11T15:59:38.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:38.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508429055000001, 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:38.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:38.716 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508388646, 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:38.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.721 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508314927000001, 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:38.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508177467000003, 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:38.728 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:38.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:38.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:38.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.734 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.508143664000002, 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:38.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:38.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:38.739 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.507838868999997, 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:38.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:38.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.744 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.507756608000001, 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:38.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.507715085999997, 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:38.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.752 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.50676318, 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:38.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:38.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:38.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.506696304000002, 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:38.757 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.761 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.506380751999998, 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:38.765 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.505835603999998, 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.769 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.505495645000003, 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:38.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:38.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:38.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.773 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.503379346000003, 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.774 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.502978935999998, 2024-06-11T15:59:38.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:38.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:38.781 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 37.50982509, 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:38.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:38.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:38.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.507842363000002, 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:38.787 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:38.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:38.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 18.506320276, 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.798 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.506923366000001, 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:38.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:38.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:38.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:38.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:38.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:38.804 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:38.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:38.806 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:38.806+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:38.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:38.906+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:38.923 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:38.924 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:38.924 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:38.924 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:38.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:39.007 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:39.008+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:39.083 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:39.083 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:39.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:39.108 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:39.109+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:39.202 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.716668546000001, 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:39.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.716107282999999, 2024-06-11T15:59:39.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.211 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.713841256999999, 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:39.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:39.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:39.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.713287047999998, 2024-06-11T15:59:39.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.706078165000001, 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:39.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:39.225 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.70565113, 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.229 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 46.247671038, 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:39.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.002219132999997, 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:39.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:39.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:39.240 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.002103863999999, 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:39.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:39.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.002072063, 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.246 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:39.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:39.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.002015299, 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:39.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:39.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.001988797000003, 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:39.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:39.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:39.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.263 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.001959749999997, 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:39.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:39.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.001908692000001, 2024-06-11T15:59:39.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:39.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:39.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 40.001857059000002, 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:39.275 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:39.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.995674973, 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.279 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:39.283 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.991353466, 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:39.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:39.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.991177651999998, 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:39.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.991109502999997, 2024-06-11T15:59:39.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:39.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:39.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.991049961000002, 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:39.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:39.301 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:39.302 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:39.303+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:39.303 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:39.340 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T15:59:39.406 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:39.407+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:39.419 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:39.419 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:39.419 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:39.419 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:39.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:39.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:39.508+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:39.534 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:39.535 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:39.535 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:39.535 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:39.535 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:39.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:39.610 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:39.611+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:39.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:39.652 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 48.515853145000001, 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:39.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:39.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.659 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.467150355999998, 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.660 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:39.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:39.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.665 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.170582637999999, 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.666 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:39.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:39.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.170532483999999, 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:39.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:39.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.677 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.170517818, 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:39.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:39.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:39.683 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.038725507000002, 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:39.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:39.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:39.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.038698267000001, 2024-06-11T15:59:39.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:39.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:39.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:39.695 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.038674069999999, 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:39.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.038600158999998, 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.701 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:39.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 46.832595906000002, 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.707 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.708 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:39.710 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.711 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.712 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 46.832515950999998, 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.713 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:39.714 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:39.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:39.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.719 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454676399, 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.720 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:39.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454641776999999, 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.725 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:39.726 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:39.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:39.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454611206999999, 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:39.731 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:39.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.735 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.736 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454585829999999, 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:39.738 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:39.739 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.740 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.741 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454561308999999, 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.744 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:39.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:39.746 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.747 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454537819999999, 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:39.748 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.749 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:39.750 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.751 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.752 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.753 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454336939000001, 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.754 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:39.755 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:39.756 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.757 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.758 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454259808000003, 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.759 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.760 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:39.761 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.762 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.763 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:39.764 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 40.454077712, 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.765 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:39.766 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:39.767 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:39.768 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:39.769 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:39.770 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:39.771 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:39.771 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:39.771 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:39.772 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:39.771+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:39.772 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:39.789 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:39.789 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:39.871 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:39.872+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:39.884 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:39.884 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:39.893 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:39.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:39.972+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:40.039 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.039 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.048 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:40.093 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:40.094+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:40.152 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.153 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.161 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:40.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:40.206+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:40.274 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:40.275+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:40.279 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.279 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.288 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:40.374 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:40.375+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:40.395 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:40.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:40.395 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-06-11T15:59:40.395 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-06-11T15:59:40.395 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-06-11T15:59:40.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-06-11T15:59:40.434 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.435 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:40.476 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:40.476+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:40.509 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:40.509 INFO:teuthology.orchestra.run.smithi171.stdout: "success": "" 2024-06-11T15:59:40.509 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:40.547 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.547 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:40.577 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:40.578+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:40.663 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.663 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.671 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:40.716 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:40.717+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:40.777 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.777 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.779 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:40.780+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:40.785 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:40.880 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:40.881+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:40.932 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:40.932 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:40.940 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:40.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:40.982+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:41.057 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.057 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.066 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:41.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:41.083+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:41.171 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.171 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.180 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:41.183 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:41.184+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:41.284 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.284 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.284 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:41.284+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:41.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:41.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T15:59:41.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:41.385+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:41.404 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.404 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.413 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:41.485 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:41.486+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:41.558 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.558 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.567 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:41.585 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:41.586+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:41.671 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.671 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:41.686 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:41.687+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:41.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:41.788+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:41.787 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.788 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.796 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:41.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:41.888 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:41.889+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:41.902 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:41.903 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:41.911 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:41.927 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:41.927 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:41.950 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:41.950 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:41.971 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:41.971 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:41.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:41.989+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.883876977, 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:42.020 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.021 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.022 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:42.023 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.024 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.025 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.026 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.027 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.835174188000003, 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:42.028 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.029 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:42.030 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.031 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.032 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:42.033 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.034 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.538606469999998, 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.035 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.036 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:42.037 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.038 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.039 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.538556315999998, 2024-06-11T15:59:42.041 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.043 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.044 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.045 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:42.046 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.538541649999999, 2024-06-11T15:59:42.047 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.048 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:42.049 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.050 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.051 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:42.052 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:42.053 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.406749339000001, 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.054 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.055 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:42.056 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.057 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.058 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.059 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.406722099, 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.060 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.061 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.062 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:42.065 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:42.065 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.065 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:42.066 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.067 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.068 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:42.069 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.406697901999998, 2024-06-11T15:59:42.069 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:42.069 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.069 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.070 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:42.071 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.073 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:42.074 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.075 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.406623991000004, 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.076 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.077 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.078 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:42.079 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.081 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.200619738, 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.082 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:42.083 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.084 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.085 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:42.086 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:42.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.200539783000004, 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:42.088 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:42.090 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.091 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.092 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822700230999999, 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.094 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:42.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.097 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.098 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.099 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822665608999998, 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.100 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:42.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.103 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:42.104 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822635038999998, 2024-06-11T15:59:42.105 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:42.106 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:42.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:42.109 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.110 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822609661999998, 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.111 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:42.115 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822585140999998, 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:42.117 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:42.120 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:42.121 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.122 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822561651999997, 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.123 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:42.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.126 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.127 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822360771, 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.129 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:42.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.131 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.132 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:42.133 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822283640000002, 2024-06-11T15:59:42.134 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.135 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:42.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.138 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:42.139 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 42.822101543999999, 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:42.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:42.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:42.144 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:42.145 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:42.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:42.146+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:42.246 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:42.247+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:42.258 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:42.259 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:42.259 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:42.259 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:42.268 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:42.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:42.348+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:42.357 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T15:59:42.414 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:42.414 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:42.414 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:42.414 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:42.414 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:42.424 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:42.467 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:42.468+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:42.530 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.334115945999997, 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.531 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:42.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333958955999996, 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.537 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:42.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:42.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.542 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333918547000003, 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:42.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:42.548 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333844827999997, 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:42.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333707367999999, 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.555 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:42.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:42.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333673564999998, 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.561 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:42.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:42.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:42.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:42.567 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.33336877, 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:42.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333286508999997, 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:42.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.575 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.333244987, 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:42.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:42.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:42.580 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.332293081000003, 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:42.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:42.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.332226204999998, 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:42.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.331910653000001, 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.590 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:42.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.331365505000001, 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:42.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:42.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.598 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.331025545999999, 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:42.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.328909246999999, 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:42.603 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:42.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.328508837000001, 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.607 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:42.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.611 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 41.335354991000003, 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:42.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.333372264000001, 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.617 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:42.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:42.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 22.331850177, 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.623 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:42.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 16.332453266999998, 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:42.627 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:42.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:42.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:42.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:42.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:42.633 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:42.635 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:42.635 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:42.635+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:42.735 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:42.736+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:42.749 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:42.750 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:42.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:42.835 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:42.836+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:42.864 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:42.864 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:42.864 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:42.873 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:42.936 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:42.937+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:42.979 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:42.979 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:42.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:42.979 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:42.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.495994963000001, 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:42.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:42.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.4954337, 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:42.984 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:42.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:42.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:42.988 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.493167673999999, 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:42.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:42.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.492613464999998, 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:42.993 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:42.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:42.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:42.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.485404582000001, 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:42.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:42.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:43.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.484977547, 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:43.002 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:43.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 50.026997455, 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:43.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:43.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781545549999997, 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:43.011 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:43.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:43.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:43.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781430280999999, 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:43.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:43.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.022 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.78139848, 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:43.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781341716, 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:43.028 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:43.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.033 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781315214000003, 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:43.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.039 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781286166999998, 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:43.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781235109000001, 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.045 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:43.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.781183476000002, 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:43.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:43.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.77500139, 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:43.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.059 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.770679883, 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:43.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:43.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.770504068999998, 2024-06-11T15:59:43.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.770435919999997, 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:43.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:43.073 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.770376378000002, 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:43.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:43.077 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.078 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:43.078 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:43.078 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:43.079 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:43.080+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:43.080 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:43.180 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:43.181+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:43.191 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:43.191 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:43.191 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:43.192 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:43.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:43.281 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:43.282+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:43.306 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:43.306 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:43.306 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:43.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:43.306 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:43.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:43.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:43.383+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 52.285647888, 2024-06-11T15:59:43.422 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.424 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:43.425 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.426 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.427 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.428 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.429 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.236945099000003, 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.430 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:43.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.432 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.433 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:43.434 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.435 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.940377380999998, 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:43.436 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.437 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.438 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:43.439 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:43.440 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.441 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.940327226999997, 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.442 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.443 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.444 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:43.445 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.446 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.447 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.940312560999999, 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.448 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.449 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.450 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.451 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:43.452 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.453 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.808520250000001, 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.454 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.455 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.456 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:43.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.458 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.459 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.808493009999999, 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.460 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:43.462 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:43.463 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.464 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:43.465 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:43.466 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.808468812999998, 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:43.467 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.468 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:43.469 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.470 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:43.471 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.472 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.808394902000003, 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.473 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.474 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.475 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:43.476 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.477 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:43.478 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.602390649, 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.479 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.480 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.481 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:43.482 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.483 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.484 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 50.602310694000003, 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:43.485 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.486 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:43.487 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.488 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.489 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:43.490 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224471141999999, 2024-06-11T15:59:43.491 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:43.492 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.493 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:43.494 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.495 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:43.496 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224436519999998, 2024-06-11T15:59:43.497 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:43.498 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.499 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.500 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:43.501 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.502 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:43.503 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224405949999998, 2024-06-11T15:59:43.505 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:43.506 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.507 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.508 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.509 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.510 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224380572999998, 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.511 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:43.512 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.513 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.514 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:43.515 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.516 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224356051999997, 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:43.517 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.518 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.519 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:43.520 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:43.521 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:43.522 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224332562999997, 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.523 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.524 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:43.525 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.526 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.527 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224131681999999, 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.528 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.529 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:43.530 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.531 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.532 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:43.533 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.224054551000002, 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.534 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:43.535 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.536 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.537 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:43.538 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.539 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 44.223872454999999, 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:43.540 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:43.541 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:43.543 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.544 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.544 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.544 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:43.544 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:43.544 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:43.545 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:43.546+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:43.546 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:43.646 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:43.646+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:43.663 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:43.663 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:43.663 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:43.673 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:43.746 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:43.747+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:43.778 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:43.779 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:43.779 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:43.779 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:43.779 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:43.787 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:43.848 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:43.849+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.70024488, 2024-06-11T15:59:43.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:43.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.700087889999999, 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:43.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:43.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:43.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.700047480999999, 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:43.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:43.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.918 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699973761999999, 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:43.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:43.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.924 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699836302000001, 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:43.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:43.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699802499, 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.931 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:43.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:43.936 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699497704000002, 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:43.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699415442999999, 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:43.941 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.942 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.942 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:43.942 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:43.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.699373921000003, 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:43.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:43.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:43.953 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.698422014999998, 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:43.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:43.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:43.958 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.698355139, 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:43.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.963 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.698039586999997, 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:43.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.967 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.697494439000003, 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:43.972 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.697154480000002, 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:43.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:43.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.695038181000001, 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:43.977 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:43.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.980 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.694637771000004, 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:43.984 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 42.701483924999998, 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:43.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:43.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.699501198, 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:43.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:43.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:43.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 23.697979110999999, 2024-06-11T15:59:43.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:43.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:43.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:43.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.000 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.698582201000001, 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:44.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:44.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:44.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:44.006 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:44.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:44.008 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.008+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.008 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:44.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:44.109+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:44.126 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:44.127 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:44.136 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:44.147 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:44.147 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:44.168 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:44.168 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:44.186 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:44.187 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:44.208 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.209+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.282 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.282 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.290 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:44.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:44.335+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:44.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T15:59:44.395 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.395 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.404 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:44.449 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.450+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:44.512+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:44.522 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.522 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:44.613 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:44.614+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:44.682 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.682 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.691 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:44.739 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.739+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.798 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.798 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.807 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:44.848 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.849+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.915 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:44.916+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:44.919 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:44.919 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:44.929 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:45.016 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:45.017+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:45.033 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.034 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.043 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:45.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:45.117+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:45.148 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.148 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:45.217 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:45.218+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:45.272 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.273 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:45.319 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:45.320+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:45.365 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T15:59:45.389 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.389 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:45.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:45.443+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:45.502 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.502 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.511 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:45.518 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:45.518 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:45.519 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-06-11T15:59:45.519 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-06-11T15:59:45.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-06-11T15:59:45.520 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:45.521+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:45.618 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.618 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.621 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:45.622+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:45.627 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:45.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:45.723+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:45.772 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.772 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.781 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:45.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:45.824+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:45.885 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:45.885 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:45.895 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:45.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:45.924+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:46.008 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:46.008 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:46.017 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:46.024 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:46.025+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:46.120 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:46.120 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:46.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:46.125+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:46.129 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:46.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:46.225 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:46.226+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:46.235 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:46.235 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:46.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:46.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:46.327+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:46.334 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:46.335 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:46.362 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:46.362 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:46.366 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:46.366 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:46.370 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.1 primary-affinity to 0 (802) 2024-06-11T15:59:46.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:46.398 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:46.398 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:46.426 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:46.427+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:46.519 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:46.519 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:46.519 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:46.519 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:46.519 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:46.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:46.528 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:46.529+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:46.629 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:46.630+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:46.634 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:46.634 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:46.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.151321142999997, 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:46.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:46.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.150759880000003, 2024-06-11T15:59:46.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:46.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.148493854000002, 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:46.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:46.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.147939645000001, 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:46.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:46.652 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.140730761999997, 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.656 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 54.140303727000003, 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:46.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:46.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.682323635000003, 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:46.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.666 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.43687173, 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:46.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436756461000002, 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.672 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:46.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436724660000003, 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:46.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:46.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436667896000003, 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.683 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:46.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.688 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436641393999999, 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:46.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:46.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436612347000001, 2024-06-11T15:59:46.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:46.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:46.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436561288999997, 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.701 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:46.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:46.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.708 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.436509655999998, 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:46.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:46.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.430327570000003, 2024-06-11T15:59:46.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.717 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.426006063000003, 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.425830249000001, 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:46.724 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:46.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.4257621, 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:46.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:46.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:46.733 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.425702557999998, 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:46.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:46.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:46.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:46.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:46.738 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:46.740 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:46.741 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:46.740+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:46.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:46.841+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:46.849 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:46.849 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:46.849 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:46.849 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:46.857 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:46.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:46.942+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:46.962 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:46.962 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:46.962 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:46.962 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:46.962 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:46.971 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:47.042 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:47.043+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:47.078 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:47.078 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:47.078 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 55.942075445, 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.079 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.080 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.081 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:47.082 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.083 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.084 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.085 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.893372655999997, 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.087 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:47.088 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:47.089 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.090 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.091 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.596804937999998, 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.092 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.093 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:47.094 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:47.095 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.096 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.097 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.596754783999998, 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.098 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.099 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.100 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:47.101 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.102 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:47.103 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.596740118, 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:47.104 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.105 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.106 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:47.107 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:47.108 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.464947807000001, 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:47.109 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.110 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.111 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:47.112 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:47.113 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.114 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.464920567, 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.115 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.116 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:47.118 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.119 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.120 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.464896369999998, 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:47.121 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.122 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.123 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.124 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:47.125 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.126 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.464822458999997, 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.127 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:47.128 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:47.129 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.130 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.131 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.132 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.258818206000001, 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.133 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.134 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.135 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.136 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:47.137 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 54.258738250999997, 2024-06-11T15:59:47.138 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.139 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:47.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:47.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880898698999999, 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.144 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:47.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.146 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.147 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.149 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880864076999998, 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.150 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.151 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.152 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.153 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880833506999998, 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.155 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:47.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:47.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:47.160 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880808129999998, 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:47.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880783608999998, 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:47.166 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:47.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:47.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880760119999998, 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:47.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.177 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880559239, 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:47.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880482108000002, 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.183 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:47.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:47.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.188 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 47.880300011999999, 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:47.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:47.192 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:47.194 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:47.195+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:47.194 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:47.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:47.296+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:47.310 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:47.310 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:47.311 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:47.311 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:47.320 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:47.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T15:59:47.398 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:47.396+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:47.426 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:47.426 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:47.426 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:47.426 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:47.426 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:47.436 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:47.496 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:47.497+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.543 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346660133, 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346503143, 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:47.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:47.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346462733999999, 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.556 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:47.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:47.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.561 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346389015, 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:47.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:47.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346251555000002, 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:47.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.346217752000001, 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:47.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:47.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:47.579 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.345912957000003, 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:47.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:47.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:47.583 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.345830696, 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:47.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.345789173999997, 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:47.588 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.344837267999999, 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.344770392000001, 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:47.597 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:47.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:47.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.344454839999997, 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:47.605 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:47.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.343909691999997, 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.609 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:47.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.343569733000002, 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:47.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.341453434000002, 2024-06-11T15:59:47.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.341053023999997, 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:47.622 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:47.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:47.626 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 46.347899177999999, 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:47.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:47.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 27.345916451000001, 2024-06-11T15:59:47.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:47.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:47.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 27.344394363999999, 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:47.638 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:47.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.344997454000001, 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:47.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:47.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:47.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:47.648 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:47.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:47.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:47.650+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:47.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:47.751+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:47.768 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:47.768 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:47.769 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:47.778 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:47.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:47.862+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:47.924 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:47.924 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:47.924 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:47.924 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:47.925 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:47.933 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:47.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:47.975+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:48.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:48.054+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:48.081 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.597926327000003, 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.082 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:48.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:48.086 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.597365064000002, 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:48.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.595099038000001, 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:48.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.594544829, 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:48.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.587335946000003, 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:48.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:48.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:48.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.586908911000002, 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:48.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 55.128928819000002, 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:48.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883476913999999, 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:48.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:48.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883361645000001, 2024-06-11T15:59:48.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:48.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:48.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.126 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883329844000002, 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:48.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883273080000002, 2024-06-11T15:59:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:48.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883246577999998, 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:48.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883217531, 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.144 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:48.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:48.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883166473000003, 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:48.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:48.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:48.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.883114839999998, 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.155 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:48.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.876932754000002, 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:48.159 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:48.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:48.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872611247000002, 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:48.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:48.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872435433, 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:48.168 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:48.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:48.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872367283999999, 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:48.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872307741999997, 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:48.177 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:48.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:48.181 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:48.183 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:48.183 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:48.183+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:48.284 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:48.285+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:48.302 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:48.302 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:48.302 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T15:59:48.302 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:48.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:48.377 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T15:59:48.396 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:48.397+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:48.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:48.460 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:48.460 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:48.460 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:48.461 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:48.461 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:48.470 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:48.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:48.486+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:48.565 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:48.565 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:48.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:48.587+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:48.596 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:48.597 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 57.479977884, 2024-06-11T15:59:48.616 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:48.617 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.618 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.619 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:48.622 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.623 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.624 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.431275094999997, 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.627 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:48.628 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.630 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:48.631 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.134707376999998, 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.632 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.633 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:48.634 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.635 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.636 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.637 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.134657222999998, 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.638 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.639 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:48.640 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:48.641 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.642 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.134642556999999, 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.644 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:48.645 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.646 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.647 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.648 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.649 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.002850246000001, 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.650 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.651 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:48.652 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:48.653 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.654 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:48.655 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.002823006, 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:48.656 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:48.657 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.658 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.659 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:48.660 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.002798808999998, 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:48.661 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.662 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:48.663 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:48.665 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.666 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.667 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 56.002724897999997, 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.668 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.669 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:48.670 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:48.671 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.672 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.673 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 55.796720645000001, 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.674 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.675 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:48.676 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:48.677 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.678 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:48.679 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 55.796640689999997, 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.680 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.681 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:48.682 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:48.683 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.684 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.685 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418801137999999, 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.686 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.687 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:48.688 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.689 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.690 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418766515999998, 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:48.691 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.692 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:48.693 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.694 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.695 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.696 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418735945999998, 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.697 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.698 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:48.699 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.701 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.702 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418710568999998, 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.703 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:48.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:48.705 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.706 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.707 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418686047999998, 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.708 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.709 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.710 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.711 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.712 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:48.713 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418662558999998, 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.714 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:48.715 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.716 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.717 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:48.718 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.719 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418461678, 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.720 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:48.721 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.722 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.723 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:48.724 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418384547000002, 2024-06-11T15:59:48.725 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:48.726 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.727 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.728 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:48.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.730 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 49.418202450999999, 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:48.731 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:48.732 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.733 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:48.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:48.735 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:48.736 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:48.737 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:48.738 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:48.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:48.737+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:48.838 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:48.838+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:48.854 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:48.854 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:48.863 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:48.938 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:48.939+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:48.968 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:48.968 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:48.977 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:49.061 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:49.062+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:49.122 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.123 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:49.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:49.176+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:49.242 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:49.243+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:49.249 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.249 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:49.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:49.343+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:49.404 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.404 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.412 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:49.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:49.454+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:49.544 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:49.545+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:49.557 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.557 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.566 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:49.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:49.646+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:49.680 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.680 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.689 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:49.746 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:49.746+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:49.794 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.794 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.804 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:49.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:49.847+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:49.948 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:49.948+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:49.951 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:49.951 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:49.960 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:50.049 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:50.049+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:50.077 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.077 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.087 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:50.176 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:50.177+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:50.237 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.237 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.245 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:50.251 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:50.252+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:50.352 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:50.353+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:50.390 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.390 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T15:59:50.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:50.453 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:50.454+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:50.515 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.515 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.524 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:50.554 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:50.555+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:50.630 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.630 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.639 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:50.655 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:50.656+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:50.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:50.744 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.744 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T15:59:50.756 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:50.756+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:50.857 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:50.857+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:50.865 INFO:teuthology.orchestra.run.smithi171.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:50.865 INFO:teuthology.orchestra.run.smithi171.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:50.874 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-06-11T15:59:50.878 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:50.879 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:50.911 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:50.911 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:50.942 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:50.942 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:50.958 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:50.959+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:51.021 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:51.021 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T15:59:51.021 INFO:teuthology.orchestra.run.smithi171.stdout: "complaint_time": 30, 2024-06-11T15:59:51.021 INFO:teuthology.orchestra.run.smithi171.stdout: "num_blocked_ops": 0 2024-06-11T15:59:51.021 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:51.031 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-06-11T15:59:51.058 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:51.059+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:51.138 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T15:59:51.138 INFO:teuthology.orchestra.run.smithi171.stdout: "size": 20, 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 600, 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [ 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 60.002189397999999, 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0166635799999999, 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.139 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 1 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135811+0000", 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.140 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135812+0000", 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.424e-06 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135819+0000", 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3189999999999997e-06 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.141 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135829+0000", 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.8099999999999992e-06 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135838+0000", 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.8349999999999993e-06 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135907+0000", 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.9225000000000002e-05 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.142 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for peered", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:51.135916+0000", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.6130000000000004e-06 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147405+0000", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0114892369999999 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147548+0000", 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00014288699999999999 2024-06-11T15:59:51.143 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.147696+0000", 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000148398 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.148509+0000", 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00081264100000000001 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.144 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152400+0000", 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003890994 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152443+0000", 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2814e-05 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.152474+0000", 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1383000000000001e-05 2024-06-11T15:59:51.145 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.953486609000002, 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0087197839999999995, 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.146 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 37 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.147 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184514+0000", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2000000000000001e-07 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184516+0000", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3010000000000001e-06 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184526+0000", 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0305999999999999e-05 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.148 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.184532+0000", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8409999999999996e-06 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188211+0000", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003678654 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188265+0000", 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3773999999999997e-05 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.149 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.188344+0000", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9884999999999998e-05 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193082+0000", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.004737471 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193157+0000", 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5048000000000004e-05 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.150 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193188+0000", 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0768000000000001e-05 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.193233+0000", 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5516000000000003e-05 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.151 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.656918890999997, 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010993467999999999, 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 115 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.152 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481081+0000", 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.35e-07 2024-06-11T15:59:51.153 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481117+0000", 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.5339000000000002e-05 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481122+0000", 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7729999999999999e-06 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.154 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481126+0000", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3950000000000003e-06 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485799+0000", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0046730570000000004 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485843+0000", 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3862000000000001e-05 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.155 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.485916+0000", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3039000000000003e-05 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489482+0000", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.003566152 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492025+0000", 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00254259 2024-06-11T15:59:51.156 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492055+0000", 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.0763999999999999e-05 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492075+0000", 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9262e-05 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.157 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.656868737000003, 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011021493, 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 116 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.158 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481131+0000", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481132+0000", 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8900000000000001e-07 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.159 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481136+0000", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8850000000000001e-06 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481140+0000", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0119999999999999e-06 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481142+0000", 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6869999999999999e-06 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.160 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486310+0000", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051674620000000003 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486356+0000", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5821000000000001e-05 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486474+0000", 2024-06-11T15:59:51.161 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000118479 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489634+0000", 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031603059999999999 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492107+0000", 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002472616 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.162 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492133+0000", 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6237e-05 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492153+0000", 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9698999999999999e-05 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.656854070999998, 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011076058999999999, 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 117 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.164 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481146+0000", 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1199999999999999e-07 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.165 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481148+0000", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1600000000000001e-06 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481152+0000", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.337e-06 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.481155+0000", 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4000000000000001e-06 2024-06-11T15:59:51.166 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486886+0000", 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0057309809999999996 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.486964+0000", 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8028000000000006e-05 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.167 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.487043+0000", 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8532e-05 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.489637+0000", 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025939679999999999 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492178+0000", 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025411520000000001 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.168 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492204+0000", 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.6537999999999999e-05 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.492222+0000", 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7751e-05 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.169 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.52506176, 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091057069999999993, 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 138 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.170 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612938+0000", 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612939+0000", 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.171 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612944+0000", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.118e-06 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612951+0000", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.148e-06 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612957+0000", 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.172 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617270+0000", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043131580000000001 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617319+0000", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9427e-05 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617394+0000", 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.4449000000000005e-05 2024-06-11T15:59:51.173 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619009+0000", 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001615699 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.621985+0000", 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029754920000000002 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.174 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622021+0000", 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6375000000000003e-05 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622044+0000", 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2840000000000002e-05 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.525034519999998, 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0091687409999999993, 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 139 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612966+0000", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2e-07 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612969+0000", 2024-06-11T15:59:51.177 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.4649999999999999e-06 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612977+0000", 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.3499999999999999e-06 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612981+0000", 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5739999999999997e-06 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.178 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617797+0000", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048156170000000003 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617869+0000", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2368999999999998e-05 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.617947+0000", 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7667e-05 2024-06-11T15:59:51.179 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619013+0000", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001065568 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622077+0000", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0030643390000000001 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622110+0000", 2024-06-11T15:59:51.180 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3501999999999999e-05 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622134+0000", 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.387e-05 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.525010322999997, 2024-06-11T15:59:51.181 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0093004750000000008, 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 140 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.612990+0000", 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.3900000000000005e-07 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.183 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613038+0000", 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7908999999999998e-05 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613046+0000", 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5399999999999998e-06 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613054+0000", 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.8019999999999992e-06 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.184 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618200+0000", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0051460910000000002 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618243+0000", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.375e-05 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.618316+0000", 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2735000000000001e-05 2024-06-11T15:59:51.185 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619373+0000", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001056394 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622248+0000", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0028750149999999999 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622273+0000", 2024-06-11T15:59:51.186 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5292000000000001e-05 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622290+0000", 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.7408e-05 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:51.187 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.524936412000002, 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0095879539999999992, 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 141 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:51.188 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613064+0000", 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8800000000000002e-07 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.189 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613068+0000", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9330000000000003e-06 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613076+0000", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.357e-06 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.613080+0000", 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7160000000000002e-06 2024-06-11T15:59:51.190 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619034+0000", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0059535919999999997 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619080+0000", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.5785999999999998e-05 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619151+0000", 2024-06-11T15:59:51.191 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0871999999999995e-05 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.619656+0000", 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00050499900000000001 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622605+0000", 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0029496959999999999 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.192 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622632+0000", 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.7185000000000001e-05 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.622652+0000", 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9230000000000001e-05 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:51.193 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.318932158999999, 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010279722, 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 164 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.194 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819068+0000", 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3000000000000001e-07 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.195 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819126+0000", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7952999999999999e-05 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819134+0000", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9610000000000005e-06 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819139+0000", 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.8609999999999997e-06 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.196 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823644+0000", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0045045170000000004 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823689+0000", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4848000000000002e-05 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.823754+0000", 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5858000000000005e-05 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.197 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.827603+0000", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038483860000000001 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829291+0000", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0016882710000000001 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829324+0000", 2024-06-11T15:59:51.198 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2966999999999998e-05 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829348+0000", 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3669999999999999e-05 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(client.4170.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 58.318852204000002, 2024-06-11T15:59:51.199 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011322435, 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "client_info": { 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "client": "client.4170", 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "client_addr": "172.21.15.89:0/59237934", 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "tid": 165 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.200 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819148+0000", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9999999999999998e-07 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819153+0000", 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.9969999999999998e-06 2024-06-11T15:59:51.201 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819160+0000", 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.0219999999999999e-06 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.819165+0000", 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7899999999999999e-06 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.202 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826564+0000", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0073992509999999999 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826609+0000", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4350000000000001e-05 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.826676+0000", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.7207999999999998e-05 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.203 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.829521+0000", 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002844521 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830418+0000", 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00089787799999999996 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830448+0000", 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.9980000000000001e-05 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.204 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:52.830470+0000", 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.1937999999999999e-05 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.941012651999998, 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012592299, 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.205 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196987+0000", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.206 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196988+0000", 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2900000000000004e-07 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.196998+0000", 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0190000000000001e-05 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197006+0000", 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.2009999999999999e-06 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.207 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197013+0000", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5069999999999997e-06 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198426+0000", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0014129290000000001 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198848+0000", 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00042173299999999998 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.208 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199233+0000", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00038523300000000002 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.203107+0000", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038741779999999998 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209524+0000", 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0064173720000000002 2024-06-11T15:59:51.209 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209558+0000", 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3181e-05 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209580+0000", 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.2246e-05 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.210 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940978029999997, 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.012710826999999999, 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.211 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197022+0000", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197023+0000", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.3599999999999999e-07 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197028+0000", 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.0900000000000004e-06 2024-06-11T15:59:51.212 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197036+0000", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.1969999999999996e-06 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197043+0000", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5850000000000002e-06 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200234+0000", 2024-06-11T15:59:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031909130000000001 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200324+0000", 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.9825000000000001e-05 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00048757500000000002 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.214 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207061+0000", 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0062496909999999999 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209626+0000", 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025650019999999998 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209688+0000", 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2067000000000001e-05 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.215 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209733+0000", 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.4446000000000001e-05 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940947459999997, 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017324042000000001, 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.216 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.217 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197053+0000", 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.2500000000000005e-07 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197058+0000", 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.2640000000000002e-06 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197064+0000", 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.511e-06 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.218 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197070+0000", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5300000000000004e-06 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207406+0000", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010336712 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207509+0000", 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000102314 2024-06-11T15:59:51.219 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207634+0000", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.000125544 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211958+0000", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0043239070000000001 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214274+0000", 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0023157659999999999 2024-06-11T15:59:51.220 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214329+0000", 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.5182000000000001e-05 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214377+0000", 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.7686999999999999e-05 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.221 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940922082999997, 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017399614000000001, 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.222 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197078+0000", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197079+0000", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197082+0000", 2024-06-11T15:59:51.223 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.128e-06 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197089+0000", 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1010000000000003e-06 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197096+0000", 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2089999999999999e-06 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.224 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.207951+0000", 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.010854548 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208023+0000", 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.1871000000000004e-05 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208099+0000", 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.5957000000000005e-05 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.225 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211964+0000", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0038657399999999999 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214420+0000", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0024559819999999998 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214454+0000", 2024-06-11T15:59:51.226 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.3695999999999997e-05 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214478+0000", 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.3609999999999999e-05 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:51.227 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940897562000004, 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017533078000000001, 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:51.228 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197103+0000", 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.1100000000000001e-07 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197106+0000", 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.1269999999999999e-06 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.229 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197114+0000", 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7400000000000004e-06 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197120+0000", 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.8200000000000002e-06 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208283+0000", 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011162923 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.230 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208347+0000", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.4832999999999994e-05 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208413+0000", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.5483999999999998e-05 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211969+0000", 2024-06-11T15:59:51.231 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0035563769999999999 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214540+0000", 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0025709729999999998 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214595+0000", 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.4755e-05 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.232 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214636+0000", 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0635e-05 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940874073000003, 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.017586458999999999, 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.233 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197126+0000", 2024-06-11T15:59:51.234 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.6800000000000001e-07 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197129+0000", 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.5679999999999998e-06 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197135+0000", 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.049e-06 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.235 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197140+0000", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.1529999999999996e-06 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208605+0000", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.01146437 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208657+0000", 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.2030000000000002e-05 2024-06-11T15:59:51.236 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.208736+0000", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.9226000000000003e-05 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.211974+0000", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0032385349999999999 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214664+0000", 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.002689234 2024-06-11T15:59:51.237 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214692+0000", 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8428999999999998e-05 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.214713+0000", 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.0497e-05 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940673191999998, 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011840567999999999, 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197327+0000", 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197328+0000", 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 5.7599999999999997e-07 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.240 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197332+0000", 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0339999999999998e-06 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197340+0000", 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 8.7120000000000006e-06 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197347+0000", 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 6.3049999999999998e-06 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.241 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198438+0000", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.001091898 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198705+0000", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00026691600000000002 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.198832+0000", 2024-06-11T15:59:51.242 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00012700799999999999 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201967+0000", 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0031346870000000002 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209100+0000", 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0071329380000000001 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.243 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209139+0000", 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.8639000000000001e-05 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209168+0000", 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.8855000000000001e-05 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.244 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940596061000001, 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011883833999999999, 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197404+0000", 2024-06-11T15:59:51.245 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197405+0000", 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.7199999999999998e-07 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197421+0000", 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.6032000000000002e-05 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.246 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197440+0000", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.9256e-05 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197465+0000", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 2.4859999999999999e-05 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199346+0000", 2024-06-11T15:59:51.247 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0018808449999999999 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199697+0000", 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00035162300000000002 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.199935+0000", 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00023715100000000001 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "op_commit", 2024-06-11T15:59:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.204792+0000", 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0048571339999999999 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209215+0000", 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0044233930000000003 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "commit_sent", 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209248+0000", 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.2728000000000002e-05 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.249 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209288+0000", 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 4.0040000000000003e-05 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "initiated_at": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "age": 51.940413964999998, 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.011861562000000001, 2024-06-11T15:59:51.250 INFO:teuthology.orchestra.run.smithi171.stdout: "continuous": false, 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "type_data": { 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "flag_point": "started", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "events": [ 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "initiated", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "header_read", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197586+0000", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "throttled", 2024-06-11T15:59:51.251 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197587+0000", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 7.2200000000000003e-07 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "all_read", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197591+0000", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 3.9110000000000003e-06 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "dispatched", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197600+0000", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 9.0210000000000005e-06 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.252 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.197610+0000", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 1.0265000000000001e-05 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "reached_pg", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.200992+0000", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0033815519999999999 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "started", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.201155+0000", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.00016360999999999999 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "event": "done", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "time": "2024-06-11T15:58:59.209448+0000", 2024-06-11T15:59:51.253 INFO:teuthology.orchestra.run.smithi171.stdout: "duration": 0.0082924810000000009 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-06-11T15:59:51.254 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T15:59:51.256 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:51.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:51.256+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:51.356 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T15:59:51.357+0000 7fe1f83ec640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31896) UID: 0 2024-06-11T15:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:51.370 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:51.380 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:51.383 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-06-11T15:59:51.383 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T15:59:51.384 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-06-11T15:59:51.384 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T15:59:51.384 INFO:teuthology.orchestra.console.smithi171:Power off 2024-06-11T15:59:51.384 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-06-11T15:59:51.395 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T15:59:51.409 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-06-11T15:59:51.410 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-06-11T15:59:51.433 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-06-11T15:59:51.457 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:51.457+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:51.487 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:51.488 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:51.488 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:51.488 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:51.488 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:51.495 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:51.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:51.559+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:51.641 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.444183426999999, 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:51.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:51.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:51.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.444026436999998, 2024-06-11T15:59:51.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:51.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:51.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443986027999998, 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.653 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:51.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:51.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443912308999998, 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.659 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:51.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:51.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.664 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443774849, 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:51.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:51.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443741046, 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:51.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:51.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443436251000001, 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:51.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443353989999999, 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:51.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:51.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.443312468000002, 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:51.685 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:51.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:51.689 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.442360561999998, 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:51.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:51.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.442293685999999, 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.694 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:51.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.698 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.441978134000003, 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:51.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.441432986000002, 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:51.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.441093027000001, 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:51.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.438976728, 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:51.712 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:51.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.438576318000003, 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.716 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:51.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:51.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:51.720 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 50.445422471999997, 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:51.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 31.443439744999999, 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.726 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:51.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:51.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 31.441917658000001, 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:51.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:51.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 25.442520748, 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:51.736 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:51.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:51.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:51.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.741 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:51.742 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:51.742 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:51.743 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:51.744 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:51.744+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:51.843 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:51.844+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:51.861 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:51.861 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:51.862 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:51.862 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:51.871 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:51.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:51.945+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:51.977 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:51.977 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:51.977 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:51.977 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:51.977 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:51.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:52.045 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:52.046+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:52.132 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:52.132 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:52.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:52.132 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:52.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.648924444999999, 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:52.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.648363181999997, 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:52.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:52.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.646097156000003, 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:52.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.645542947000003, 2024-06-11T15:59:52.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:52.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.638334063999999, 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:52.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.155 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.637907028999997, 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:52.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.179926936999998, 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.160 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:52.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934475032000002, 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:52.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:52.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934359763000003, 2024-06-11T15:59:52.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:52.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:52.175 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934327961999998, 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:52.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934271197999998, 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:52.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934244696, 2024-06-11T15:59:52.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:52.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:52.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:52.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934215649000002, 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:52.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:52.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:52.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934164590999998, 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:52.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:52.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.934112958, 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:52.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.927930871999997, 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:52.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:52.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.923609364999997, 2024-06-11T15:59:52.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.217 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.923433551000002, 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:52.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:52.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:52.222 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.923365402000002, 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:52.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.923305859999999, 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:52.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:52.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:52.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.231 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.232 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:52.232 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:52.232 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:52.233 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:52.234 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:52.234+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:52.334 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:52.335+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:52.342 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:52.342 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:52.342 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:52.342 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:52.351 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:52.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:52.436+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:52.496 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:52.496 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:52.496 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:52.496 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:52.497 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:52.505 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:52.549 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:52.550+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.612 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415490103000003, 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:52.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415333113000003, 2024-06-11T15:59:52.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:52.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:52.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415292704000002, 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:52.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.629 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415218985000003, 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:52.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:52.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:52.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.635 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415081524999998, 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:52.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.415047721999997, 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:52.641 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:52.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.414742926999999, 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.647 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:52.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:52.651 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.414660666000003, 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:52.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.655 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.414619144, 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:52.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.413667238000002, 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:52.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:52.664 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.413600361999997, 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:52.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:52.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:52.669 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.41328481, 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.412739662, 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.673 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:52.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:52.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.412399702999998, 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.678 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:52.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:52.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.682 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.410283403999998, 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.409882994, 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:52.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:52.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 51.416729148000002, 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:52.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:52.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.414746420999997, 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.697 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:52.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:52.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 32.413224333999999, 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:52.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:52.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 26.413827424000001, 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:52.707 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:52.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:52.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:52.712 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.713 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.713 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.713 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:52.713 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:52.713 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:52.714 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:52.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:52.715+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:52.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:52.815+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:52.831 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:52.831 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:52.831 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:52.831 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:52.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:52.915 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:52.916+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:52.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:52.985 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:52.985 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:52.985 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:52.985 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:52.986 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:52.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:53.016 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.017+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.086 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:53.086 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:53.100 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:53.100 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:53.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.617285219000003, 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:53.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:53.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:53.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.616723956000001, 2024-06-11T15:59:53.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:53.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.109 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.61445793, 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:53.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:53.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:53.114 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.613903721, 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:53.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.606694838000003, 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:53.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.606267803000001, 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.126 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.148287711000002, 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:53.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:53.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902835805999999, 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:53.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902720537, 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902688736000002, 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:53.146 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:53.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:53.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902631972000002, 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902605469999997, 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.157 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:53.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902576422999999, 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:53.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:53.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902525365000002, 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:53.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:53.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.902473731999997, 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.896291646000002, 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:53.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.891970139000001, 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.182 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.186 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.891794324999999, 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:53.190 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.891726175999999, 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:53.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:53.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:53.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.891666634000003, 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:53.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:53.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.199 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:53.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:53.200 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:53.201 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:53.201 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:53.202 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2: {} 2024-06-11T15:59:53.202 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:53.203 INFO:teuthology.orchestra.run.smithi089.stderr:osd.2: osd_enable_op_tracker = '' 2024-06-11T15:59:53.204 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.202+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:53.303+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:53.310 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.310 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.319 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:53.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:53.404+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:53.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T15:59:53.423 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.423 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.432 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:53.504 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.504+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.537 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.537 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.546 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:53.604 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.606+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.651 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.651 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.660 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:53.706 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.707+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.765 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.765 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:53.806 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:53.807+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:53.879 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.879 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:53.887 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:53.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:53.908+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:53.995 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:53.995 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.004 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:54.048 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:54.049+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:54.109 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.110 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.110 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:54.110+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:54.119 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:54.210 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:54.211+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:54.264 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.265 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.273 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:54.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:54.318+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:54.379 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.379 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.388 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:54.389 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T15:59:54.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:54.430+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:54.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:54.513+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:54.533 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.533 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.542 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:54.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:54.627+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:54.689 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.689 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.698 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:54.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:54.739+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:54.804 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.805 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.813 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:54.816 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:54.816+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:54.916 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:54.917+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:54.919 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:54.919 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:54.928 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:55.017 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:55.018+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:55.074 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:55.074 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:55.083 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:55.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.128+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.189 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:55.189 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:55.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:55.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T15:59:55.220 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:55.220+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:55.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.321+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.343 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:55.343 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:55.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:55.392 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:55.392 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:55.425 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:55.426 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:55.434 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-06-11T15:59:55.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.436+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.500 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:55.500 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.016979243000002, 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:55.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.505 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.01641798, 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:55.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:55.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.014151953999999, 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.514 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.013597744999998, 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:55.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:55.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.006388862000001, 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.519 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.005961827, 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:55.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:55.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.547981735, 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:55.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302529829999997, 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.533 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:55.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:55.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302414560999999, 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:55.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.544 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.30238276, 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:55.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:55.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302325996, 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.550 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:55.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:55.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302299494000003, 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:55.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302270446999998, 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.561 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.566 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302219389000001, 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:55.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.302167756000003, 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:55.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:55.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:55.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:55.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.29598567, 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:55.579 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.583 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.291664163, 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:55.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:55.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:55.588 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.291488348999998, 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:55.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:55.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:55.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.291420199999997, 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.593 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:55.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:55.597 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.291360658000002, 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:55.601 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.602 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.602 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.602 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:55.602 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:55.602 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:55.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.604+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:55.605 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-06-11T15:59:55.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.705+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.711 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:55.711 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:55.711 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:55.711 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:55.720 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:55.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.807+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.823 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:55.823 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:55.823 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:55.823 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:55.824 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:55.832 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:55.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:55.907+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:55.915 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T15:59:55.919 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T15:59:55.919 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T15:59:55.939 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:55.939 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:55.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:55.939 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742830292000001, 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:55.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:55.945 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742673302, 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:55.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:55.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742632893, 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.951 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:55.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:55.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:55.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742559174, 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:55.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.962 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742421714000002, 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:55.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742387911000002, 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.968 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:55.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:55.973 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742083116000003, 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:55.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.742000855000001, 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.978 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:55.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:55.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:55.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.741959332999997, 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:55.982 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:55.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:55.986 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.741007427, 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:55.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:55.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.740940551000001, 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:55.991 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:55.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:55.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:55.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:55.995 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.740624998999998, 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:55.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:55.999 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.740079850999997, 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:56.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:56.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.739739892000003, 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.004 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:56.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:56.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.737623593000002, 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.737223182999998, 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.012 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 54.744069336999999, 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.016 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:56.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.742086610000001, 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:56.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:56.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:56.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.740564523000003, 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:56.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:56.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 29.741167613000002, 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.031 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:56.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:56.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.037 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.037 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:56.038 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:56.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.039+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.140+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.145 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:56.146 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:56.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:56.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.241+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.299 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:56.299 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:56.299 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:56.299 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:56.299 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:56.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:56.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.349+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T15:59:56.442 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:56.443+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:56.455 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:56.455 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:56.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:56.455 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:56.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.972283244000003, 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:56.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.971721981000002, 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.460 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:56.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:56.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.969455955000001, 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:56.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.968901746, 2024-06-11T15:59:56.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:56.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:56.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.961692863000003, 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:56.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.961265828000002, 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:56.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 63.503285736000002, 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:56.483 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:56.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:56.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257833830999999, 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.488 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:56.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:56.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:56.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257718562000001, 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:56.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.499 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257686761000002, 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:56.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:56.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:56.505 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257629997000002, 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:56.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:56.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:56.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.514 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257603494999998, 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:56.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257574448, 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:56.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:56.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:56.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257523390000003, 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:56.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.257471756999998, 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:56.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:56.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.251289671000002, 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:56.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:56.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.246968164000002, 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:56.540 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:56.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:56.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.24679235, 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:56.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.246724200999999, 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:56.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:56.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:56.553 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.246664658999997, 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:56.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:56.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:56.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:56.558 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:56.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.560+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.560 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:56.661 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:56.661+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:56.672 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:56.672 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:56.672 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:56.672 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:56.681 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:56.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:56.763+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:56.828 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:56.828 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:56.828 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:56.828 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:56.828 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:56.838 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:56.881 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:56.882+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:56.945 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748495615000003, 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:56.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748338625000002, 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:56.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:56.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.956 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748298216000002, 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:56.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:56.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:56.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748224497000002, 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.962 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:56.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:56.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.967 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748087036999998, 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:56.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:56.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.748053233999997, 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.973 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.747748438999999, 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:56.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:56.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:56.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.747666178000003, 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:56.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:56.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:56.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.747624655999999, 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:56.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.746672750000002, 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.991 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:56.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.746605873999997, 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:56.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:56.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.746290322, 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:57.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:57.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:57.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.745745174, 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:57.007 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:57.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:57.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.011 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.745405214999998, 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.743288915999997, 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:57.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.742888506, 2024-06-11T15:59:57.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:57.023 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 55.749734660000001, 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:57.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:57.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.028 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 36.747751933000004, 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:57.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:57.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:57.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.034 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 36.746229845999999, 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:57.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:57.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 30.746832936000001, 2024-06-11T15:59:57.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:57.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:57.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.043 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:57.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:57.045 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:57.045+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:57.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:57.146+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:57.152 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:57.152 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:57.153 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:57.153 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:57.161 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:57.247 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:57.248+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:57.306 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:57.306 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:57.306 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T15:59:57.306 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T15:59:57.306 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:57.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:57.347 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:57.349+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:57.404 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.422 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.938988682000002, 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T15:59:57.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T15:59:57.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.938427419000007, 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.427 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T15:59:57.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T15:59:57.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.936161393000006, 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T15:59:57.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.935607184000006, 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T15:59:57.436 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.928398301000001, 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T15:59:57.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.927971266, 2024-06-11T15:59:57.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:57.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T15:59:57.449 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 64.469991174, 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T15:59:57.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T15:59:57.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.454 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224539268999997, 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T15:59:57.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224423999999999, 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T15:59:57.460 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T15:59:57.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T15:59:57.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224392199, 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.466 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T15:59:57.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.471 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224335435, 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T15:59:57.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T15:59:57.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T15:59:57.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224308933000003, 2024-06-11T15:59:57.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T15:59:57.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224279885999998, 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T15:59:57.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T15:59:57.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224228828000001, 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T15:59:57.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.495 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.224177195000003, 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T15:59:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T15:59:57.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.217995109, 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T15:59:57.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T15:59:57.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T15:59:57.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.506 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.213673602, 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T15:59:57.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T15:59:57.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.511 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.213497787999998, 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T15:59:57.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.213429638999997, 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.516 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T15:59:57.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 58.213370097000002, 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T15:59:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T15:59:57.525 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:57.528 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:57.528 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:57.527+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:57.628 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:57.628+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:57.634 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T15:59:57.635 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:57.643 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:57.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:57.730+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:57.788 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:57.788 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T15:59:57.788 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T15:59:57.788 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T15:59:57.788 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:57.798 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:57.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:57.831+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708538140000002, 2024-06-11T15:59:57.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T15:59:57.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T15:59:57.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T15:59:57.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708381150000001, 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T15:59:57.911 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T15:59:57.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.916 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708340741000001, 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T15:59:57.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T15:59:57.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T15:59:57.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708267022000001, 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:57.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T15:59:57.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.928 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708129562000003, 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T15:59:57.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T15:59:57.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.708095759000003, 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.934 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T15:59:57.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T15:59:57.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.939 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.707790963999997, 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T15:59:57.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.707708703000002, 2024-06-11T15:59:57.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T15:59:57.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T15:59:57.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.707667180999998, 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T15:59:57.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T15:59:57.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.706715275000001, 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T15:59:57.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T15:59:57.957 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.706648399000002, 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T15:59:57.961 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.706332846999999, 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:57.962 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T15:59:57.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.705787698999998, 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.966 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T15:59:57.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T15:59:57.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.705447739999997, 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T15:59:57.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T15:59:57.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.703331441000003, 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.975 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T15:59:57.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T15:59:57.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.702931030999999, 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T15:59:57.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T15:59:57.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.709777185, 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T15:59:57.983 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T15:59:57.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 37.707794458000002, 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T15:59:57.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T15:59:57.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 37.706272370999997, 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T15:59:57.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T15:59:57.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:57.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 31.706875460999999, 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:57.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T15:59:58.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T15:59:58.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T15:59:58.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T15:59:58.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T15:59:58.004 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T15:59:58.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T15:59:58.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:58.007 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:58.007+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:58.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:58.108+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:58.116 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T15:59:58.116 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T15:59:58.116 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T15:59:58.116 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T15:59:58.125 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:58.143 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T15:59:58.143 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T15:59:58.175 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T15:59:58.176 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T15:59:58.176 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T15:59:58.180 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T15:59:58.180 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T15:59:58.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:58.210+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:58.270 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.270 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.279 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:58.309 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:58.310+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:58.410 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:58.411+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:58.423 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.423 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.432 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:58.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:58.512+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:58.539 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.540 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.549 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:58.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:58.613+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:58.654 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.654 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.663 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:58.713 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:58.714+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:58.768 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.768 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:58.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:58.822+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:58.885 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:58.885 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:58.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:58.915 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:58.916+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:59.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.017+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.038 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.038 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.047 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:59.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.131+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.191 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.191 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.200 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T15:59:59.243 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:59.244+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:59.307 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.308 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.316 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T15:59:59.357 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:59.358+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:59.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.421+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.460 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.460 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.469 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T15:59:59.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.521+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T15:59:59.573 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.573 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T15:59:59.606 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-06-11T15:59:59.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.627+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.688 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.688 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T15:59:59.717 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-06-11T15:59:59.723 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:59.724+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:59.817 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-06-11T15:59:59.824 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T15:59:59.825+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T15:59:59.842 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.842 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.850 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T15:59:59.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T15:59:59.925+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T15:59:59.954 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T15:59:59.954 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T15:59:59.963 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:00.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:00.027+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:00.069 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:00.069 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:00.078 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:00.126 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.127+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:00.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:00.190 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:00.190 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:00.200 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:00.241 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.242+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:00.312 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:00.313 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:00.329 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.330+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:00.332 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:00.332 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:00.332 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:00.336 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:00.337 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:00.347 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:00.347 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:00.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:00.347 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:00.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.348 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.348 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150766175999998, 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:00.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:00.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:00.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150609185999997, 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:00.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:00.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:00.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150568776999997, 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:00.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:00.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:00.366 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150495057999997, 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:00.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:00.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:00.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150357597999999, 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.372 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:00.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:00.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.378 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150323794999998, 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:00.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:00.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:00.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:00.384 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.150019, 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:00.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:00.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.149936738999997, 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:00.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:00.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.149895217000001, 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.393 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:00.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.397 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.148943310999996, 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:00.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:00.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.148876434999998, 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.407 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.148560883000002, 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:00.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:00.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.148015735000001, 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:00.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:00.416 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.147675776, 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:00.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.145559476999999, 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.421 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:00.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.145159067000002, 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:00.425 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:00.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:00.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:00.429 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 59.152005221000003, 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:00.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:00.435 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 40.150022493999998, 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:00.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 40.148500407, 2024-06-11T16:00:00.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:00.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:00.445 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 34.149103496999999, 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:00.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:00.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:00.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:00.451 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:00.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:00.453 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.453+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:00.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:00.553+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:00.566 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:00.567 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:00.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:00.654 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.655+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:00.697 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:00:00.722 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:00.722 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:00.722 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:00.722 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:00.722 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:00.731 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:00.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:00.775+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.354671381000003, 2024-06-11T16:00:00.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:00.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.354110117999994, 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.843 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:00.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:00.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.351844091999993, 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:00.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:00.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.351289883000007, 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:00.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:00.857 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.344081000000003, 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.861 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.343653965000001, 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:00.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:00.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:00.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.885673873000002, 2024-06-11T16:00:00.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:00.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.870 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.640221967999999, 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:00.876 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.640106699, 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:00.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:00.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:00.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.640074898000002, 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.883 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.888 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.640018134000002, 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:00.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:00.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:00.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.639991631999997, 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.894 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:00.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.639962584999999, 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:00.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:00.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:00.905 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.639911527000002, 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:00.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:00.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.911 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.639859893999997, 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:00.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:00.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:00.916 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.633677808000002, 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:00.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:00.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.629356301000001, 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.921 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:00.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:00.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.629180486999999, 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.926 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.629112337999999, 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:00.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.629052796000003, 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:00.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:00.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:00.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:00.939 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:00.940 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:00.941 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:00.942 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:00.942+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:01.042 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:01.043+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:01.049 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:01.049 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:01.049 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:01.050 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:01.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:01.143 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:01.144+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:01.202 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:01.202 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:01.202 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:01.202 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:01.202 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:01.211 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:01.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:01.245+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:01.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-06-11T16:00:01.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:01.347+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:01.357 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.161206763000003, 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.358 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:01.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:01.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.161049773000002, 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.364 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:01.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:01.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.161009364000002, 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.370 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:01.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:01.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160935645000002, 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.376 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:01.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:01.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160798184999997, 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:01.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.388 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160764382000004, 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:01.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:01.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:01.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:01.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.395 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160459586999998, 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:01.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160377326000003, 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:01.400 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:01.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:01.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.160335803999999, 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:01.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:01.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:01.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:01.410 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.159383898000002, 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:01.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:01.415 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.159317022000003, 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:01.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.419 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.15900147, 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:01.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.158456321999999, 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:01.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:01.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.428 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.158116362999998, 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:01.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.156000063999997, 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.433 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:01.436 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.155599654, 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:01.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 60.162445808000001, 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:01.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.446 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 41.160463081000003, 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 41.158940993999998, 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.452 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 35.159544083999997, 2024-06-11T16:00:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:01.462 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:01.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:01.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:01.464+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:01.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:01.565+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:01.576 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:01.576 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:01.576 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:01.576 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:01.585 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:01.665 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:01.667+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:01.729 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:01.730 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:01.738 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:01.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:01.782+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.361661029000004, 2024-06-11T16:00:01.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:01.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:01.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.361099765999995, 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:01.850 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:01.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:01.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.358833739999994, 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:01.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:01.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.358279530999994, 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:01.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:01.864 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.351070648000004, 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:01.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:01.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.350643613000003, 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:01.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.892663521000003, 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.879 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.647211616, 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.647096347000002, 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:01.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:01.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.647064546000003, 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:01.892 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:01.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:01.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.647007782000003, 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:01.898 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:01.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.646981279999999, 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.904 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:01.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:01.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.646952233, 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.910 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:01.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:01.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.646901174999996, 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.916 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:01.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:01.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.921 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.646849541999998, 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:01.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:01.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.640667456000003, 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.926 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:01.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.636345949000003, 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:01.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:01.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:01.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.636170135, 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:01.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:01.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:01.940 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.636101986, 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:01.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:01.945 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.636042443999997, 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:01.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:01.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:01.950 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:01.951 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:01.952+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:01.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:02.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.053+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.060 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:02.060 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:02.061 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:02.061 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:02.069 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:02.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.154+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.173 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:02.173 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:02.173 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:02.173 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:02.174 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:02.182 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:02.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.256+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.289 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.093257969, 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.290 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:02.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:02.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.093100978999999, 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.296 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:02.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.301 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.093060569999999, 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.302 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:02.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.307 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092986850999999, 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:02.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:02.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092849391000001, 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:02.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092815588000001, 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:02.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:02.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:02.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092510793000002, 2024-06-11T16:00:02.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.329 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092428532, 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:02.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:02.333 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.092387010000003, 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:02.334 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:02.338 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.091435103999999, 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:02.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.091368228, 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.343 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:02.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:02.347 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.091052675999997, 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:02.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.090507528000003, 2024-06-11T16:00:02.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.355 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.090167569000002, 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:02.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:02.360 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.088051270000001, 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.087650859999997, 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.364 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:02.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.094497013999998, 2024-06-11T16:00:02.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:02.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 42.092514287, 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:02.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:02.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 42.090992200000002, 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:02.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.383 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 36.091595290000001, 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:02.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:02.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:02.389 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:02.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:02.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:02.392 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:02.392+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:02.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.492+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.500 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:02.500 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:02.500 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:02.500 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:02.509 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:02.532 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:02.532 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:02.564 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:02.565 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:02.565 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:02.569 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:02.569 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:02.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.594+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.653 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:02.653 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:02.662 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:02.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.704+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:00:02.795 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:02.796+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:02.807 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:02.807 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:02.817 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:02.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:02.897+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:02.924 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:02.924 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:02.934 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:02.997 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:02.997+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:03.040 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.040 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.049 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:03.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.099+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.193 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.194 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.199 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:03.200+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:03.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:03.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.300+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.310 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.311 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.319 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:03.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.404+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.464 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.464 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:03.502 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:03.503+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:03.603 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:03.605+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:03.617 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.617 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.625 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:03.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.705+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.718 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:00:03.732 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.732 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:03.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.806+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.846 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.846 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.855 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:03.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:03.907+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:03.960 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:03.960 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:03.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:04.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:04.015+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:04.077 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:04.078 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:04.087 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:04.108 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:04.109+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:04.208 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:04.210+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:04.232 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:04.233 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:04.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:04.309 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:04.310+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:04.347 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:04.347 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:04.356 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:04.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:04.410+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:04.460 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:04.461 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:04.469 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:04.513 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:04.514+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:04.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:04.573 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:04.573 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:04.582 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:04.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:04.612+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:04.712 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:04.713+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:04.713 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:04.714 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:04.729 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532800917000003, 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:04.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:04.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:04.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:04.735 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532643926999995, 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:04.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:04.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:04.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532603518000002, 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:04.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532529799000002, 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:04.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:04.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532392338999998, 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:04.752 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:04.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:04.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:04.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532358536000004, 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:04.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:04.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:04.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.764 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.532053740999999, 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:04.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.531971479999996, 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.769 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:04.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.531929958000006, 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:04.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:04.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.778 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.530978051999995, 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.781 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:04.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.530911176000004, 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:04.783 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:04.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.787 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.530595624, 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:04.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.791 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.530050476, 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:04.794 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.529710516999998, 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:04.800 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.527594218000004, 2024-06-11T16:00:04.801 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:04.802 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.803 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:04.804 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.527193808000007, 2024-06-11T16:00:04.805 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.806 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:04.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.534039962000001, 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:04.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:04.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:04.815 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.532057235000003, 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:04.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.530535147999998, 2024-06-11T16:00:04.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 38.531138237999997, 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:04.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:04.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:04.831 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:04.832 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:04.833 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:04.834 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:04.834 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:04.835 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:04.835 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:04.835 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:04.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:04.834+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:04.919 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:04.919 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:04.919 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.23307415564046613 2024-06-11T16:00:04.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.23307415564046613 2024-06-11T16:00:04.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:04.934+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:04.945 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:04.945 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:04.945 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:04.945 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:04.954 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:05.038 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:05.039+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:05.257 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:05.257 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:05.257 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:05.257 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:05.257 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:05.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:05.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:05.258+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:05.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:05.359+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:05.406 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:05.406 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:05.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.922924140000006, 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:05.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:05.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:05.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:05.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:05.412 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.922362876999998, 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:05.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.920096850999997, 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:05.417 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:05.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.421 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.919542641999996, 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:05.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.426 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.912333759000006, 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:05.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.911906724000005, 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:05.431 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:05.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.453926632000005, 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:05.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:05.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.440 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208474726999995, 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:05.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:05.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.446 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208359458000004, 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:05.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208327656999998, 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.452 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.457 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208270893000005, 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:05.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:05.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208244390999994, 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.463 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:05.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:05.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.468 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208215343999996, 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:05.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:05.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208164285999999, 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:05.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.208112653000001, 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:05.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:05.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.201930567000005, 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:05.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:05.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.197609060000005, 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:05.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:05.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.197433246000003, 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.493 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.197365097000002, 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:05.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.197305555, 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:05.502 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:05.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:05.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:05.507 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:05.507 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:05.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:05.508+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:05.508 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:05.609 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:05.610+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:05.618 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:05.618 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:05.618 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:05.619 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:05.627 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:05.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:05.712+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:05.717 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 0.233074 (3baa) 2024-06-11T16:00:05.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T16:00:05.787 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:05.787 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:05.787 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:05.787 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:05.787 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:05.796 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:05.839 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:05.840+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:05.902 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:05.902 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:05.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:05.902 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:05.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705579118000003, 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:05.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:05.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.908 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705422127999995, 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:05.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705381719000002, 2024-06-11T16:00:05.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:05.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:05.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:05.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705308000000002, 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:05.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:05.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.929 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705170539999997, 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:05.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:05.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:05.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.705136737000004, 2024-06-11T16:00:05.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:05.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:05.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:05.942 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.704831941999998, 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:05.943 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:05.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.947 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.704749680999996, 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:05.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.704708159000006, 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:05.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.703756252999995, 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:05.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.703689377000003, 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.963 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:05.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:05.968 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.703373825, 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:05.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.972 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.702828676999999, 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:05.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:05.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.702488717999998, 2024-06-11T16:00:05.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:05.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.700372419000004, 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:05.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:05.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 66.699972009000007, 2024-06-11T16:00:05.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:05.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 64.706818162999994, 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:05.993 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:05.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:05.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:05.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:05.999 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.704835436000003, 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:06.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:06.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.006 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 45.703313348999998, 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:06.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 39.703916438999997, 2024-06-11T16:00:06.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:06.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.017 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.018 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.018 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:06.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:06.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.020+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.120 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:06.122+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:06.126 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:06.127 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:06.127 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:06.127 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:06.135 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:06.221 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:06.223+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:06.241 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:06.241 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:06.241 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:06.241 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:06.241 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:06.250 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:06.322 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:06.324+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:06.356 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.872656914999993, 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:06.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.872095651999999, 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.361 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:06.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.869829625999998, 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.366 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:06.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.869275416999997, 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:06.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:06.375 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.862066533999993, 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:06.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.861639499000006, 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:06.380 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:06.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 73.403659407000006, 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:06.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:06.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:06.389 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.158207501999996, 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:06.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:06.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:06.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.158092233000005, 2024-06-11T16:00:06.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:06.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:06.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.158060431999999, 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:06.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:06.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:06.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.406 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.158003668000006, 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:06.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:06.412 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.157977165999995, 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:06.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.157948118999997, 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:06.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.157897061, 2024-06-11T16:00:06.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:06.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:06.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.431 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.157845428000002, 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:06.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.151663342000006, 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:06.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:06.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:06.440 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.147341835000006, 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:06.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:06.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:06.445 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.147166021000004, 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:06.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.147097872000003, 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.450 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 67.147038330000001, 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:06.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:06.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:06.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:06.459 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:06.459 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:06.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.461+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:06.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.562+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.570 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:06.570 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:06.570 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:06.571 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:06.579 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:06.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.663+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.683 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:06.683 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:06.683 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:06.683 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:06.683 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:06.692 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:06.715 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T16:00:06.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.763+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.806 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:06.806 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:06.806 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:06.806 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:06.806 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609908083999997, 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.807 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:06.808 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.809 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:06.810 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.811 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.812 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609751094000003, 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.813 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.814 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.815 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:06.816 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:06.817 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609710684999996, 2024-06-11T16:00:06.818 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.819 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:06.820 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.821 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.822 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:06.823 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609636965999997, 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.824 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.825 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:06.826 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.827 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.828 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.829 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609499506000006, 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.830 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:06.831 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.833 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.834 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.835 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:06.836 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609465702999998, 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.837 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:06.838 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.839 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.840 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:06.841 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.842 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609160908000007, 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:06.843 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.844 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.845 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.846 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609078647000004, 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.847 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.848 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:06.849 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.850 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.851 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.609037125, 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.852 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.853 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.854 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.608085219000003, 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.856 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:06.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:06.860 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.608018342999998, 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:06.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:06.864 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.607702790999994, 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.865 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.866 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:06.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.607157642999994, 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.869 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:06.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:06.873 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.606817684000006, 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.874 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:06.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 18/16 rep_tid 0 lcod 18'1)", 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:06.879 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.604701384999998, 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00030670300000000002, 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201708+0000", 2024-06-11T16:00:06.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201709+0000", 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7399999999999991e-07 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201714+0000", 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2989999999999996e-06 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201724+0000", 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9010000000000006e-06 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201731+0000", 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3989999999999998e-06 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201786+0000", 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4332000000000001e-05 2024-06-11T16:00:06.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202014+0000", 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000228798 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.604300975000001, 2024-06-11T16:00:06.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.887 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.611147129000003, 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.888 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:06.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:06.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.893 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 46.609164401999998, 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:06.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:06.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:43 3.6 e20/16 ondisk, result = 0)", 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.899 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 46.607642315, 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00032323900000000001, 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198767+0000", 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198773+0000", 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6100000000000002e-06 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198783+0000", 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2e-06 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198809+0000", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6492999999999999e-05 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198821+0000", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2316e-05 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198992+0000", 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000170567 2024-06-11T16:00:06.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199000+0000", 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0339999999999997e-06 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199090+0000", 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0019000000000007e-05 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.903 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 40.608245404999998, 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:06.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:06.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:06.909 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:06.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:06.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:06.912+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:06.912 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:07.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.012+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.017 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:07.017 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:07.018 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:07.018 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:07.026 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:07.038 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:07.038 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:07.070 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:07.070 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:07.074 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:07.074 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:07.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.113+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.171 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.172 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:07.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-06-11T16:00:07.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.222+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.315+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.327 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.327 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.335 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:07.415 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:07.416+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:07.442 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.442 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.451 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:07.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.517+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.595 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.595 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.604 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:07.650 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:07.650+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:07.709 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.710 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.718+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.720 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:07.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:07.819+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:07.825 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.825 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.834 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:07.919 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:07.920+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:07.979 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:07.979 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:07.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:08.020 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:08.022+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:08.093 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.093 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.102 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:08.146 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:08.147+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:08.210 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.210 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.219 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:08.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:08.223+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:08.322 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:08.323+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:08.364 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.364 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.373 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:08.457 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:08.458+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:08.519 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.519 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:08.524+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:08.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:08.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:08.624+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:08.636 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.636 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:08.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:08.729+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:08.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T16:00:08.792 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.792 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:08.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:08.843+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:08.926 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:08.927+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:08.946 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:08.946 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:08.955 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:09.026 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:09.027+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:09.070 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:09.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:09.154 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:09.155+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:09.214 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:09.214 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:09.216 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:09.216 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:09.216 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:09.216 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:09.216 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:09.225 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:09.235 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:09.235 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:09.236 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:09.239 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:09.240 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:09.266 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:09.267+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:09.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:09.331+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:09.372 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:09.372 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:09.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:09.372 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:09.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.175238977000006, 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:09.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:09.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:09.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.175081986999999, 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.384 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.175041578000005, 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:09.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:09.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174967859000006, 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:09.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:09.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:09.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:09.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174830399000001, 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:09.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174796595999993, 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:09.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.408 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174491801000002, 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:09.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174409539999999, 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.413 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:09.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.417 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.174368017999996, 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:09.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.173416111999998, 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:09.422 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.426 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.173349236000007, 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:09.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:09.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.173033684000004, 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:09.432 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:09.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.172488536000003, 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.436 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:09.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.172148577000002, 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.441 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:09.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:09.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 70.169631867999996, 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:09.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:09.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:09.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 68.176478021999998, 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.450 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:09.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:09.455 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.174495295, 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:09.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 43.173576298, 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:09.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:09.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.467 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.6340366240000002, 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:09.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:09.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:09.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.6233491870000001, 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:09.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:09.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:09.476 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:09.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:09.478 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:09.479+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:09.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:09.579+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:09.584 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:09.585 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:09.585 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:09.585 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:09.593 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:09.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:09.680+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:09.736 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T16:00:09.740 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:09.740 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:09.740 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:09.740 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:09.740 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:09.749 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:09.780 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:09.781+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:09.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:09.881+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:09.896 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.413452895000006, 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.897 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.412891631999997, 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:09.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.906 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.410625605999996, 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:09.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:09.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.410071396999996, 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:09.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:09.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.402862514000006, 2024-06-11T16:00:09.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.402435479000005, 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:09.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:09.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:09.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 76.944455387000005, 2024-06-11T16:00:09.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:09.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:09.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.699003481999995, 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:09.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:09.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:09.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698888213000004, 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:09.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:09.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698856411999998, 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.941 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698799648000005, 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.951 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698773145999994, 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698744098999995, 2024-06-11T16:00:09.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698693040999999, 2024-06-11T16:00:09.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:09.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:09.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.698641408, 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.968 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:09.972 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.692459322000005, 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:09.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:09.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.688137815000005, 2024-06-11T16:00:09.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:09.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.687962001000002, 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.982 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:09.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:09.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.687893852000002, 2024-06-11T16:00:09.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:09.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:09.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.68783431, 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:09.992 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:09.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:09.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:09.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:09.996 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:09.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:09.999+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:09.998 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:10.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.099+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.105 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:10.105 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:10.105 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:10.105 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:10.114 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:10.199 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:10.199+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:10.220 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:10.220 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:10.220 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:10.220 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:10.220 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:10.229 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:10.319 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:10.317+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:10.376 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180560913999997, 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:10.377 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:10.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:10.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.384 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180403924000004, 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:10.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:10.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:10.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180363514999996, 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.392 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:10.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:10.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:10.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180289795999997, 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.399 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:10.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:10.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:10.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180152336000006, 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.406 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:10.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:10.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:10.412 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.180118532999998, 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:10.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.418 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.179813738000007, 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:10.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:10.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.179731477000004, 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:10.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.179689955000001, 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:10.427 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:10.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.431 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.178738049000003, 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:10.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.178671172999998, 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.436 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:10.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.440 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.178355620999994, 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:10.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:10.444 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.177810472999994, 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:10.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:10.448 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.177470514000007, 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:10.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:10.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.174953805000001, 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:10.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.457 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 69.181799959000003, 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:10.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:10.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:10.463 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 50.179817231999998, 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:10.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 44.178898234999998, 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.469 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.416+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:10.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.475 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.6393585609999999, 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:10.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:10.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.6286711240000002, 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:10.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:10.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:10.484 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:10.484 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:10.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.535+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.598 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:10.598 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:10.598 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:10.598 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:10.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:10.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.651+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.715+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:10.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:10.735 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-06-11T16:00:10.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T16:00:10.753 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:10.753 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:10.754 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:10.754 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:10.754 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:10.762 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:10.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:10.847+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:10.909 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.426417612999998, 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:10.910 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.425856350000004, 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:10.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:10.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.423590324000003, 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:10.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.926 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.423036115000002, 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:10.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.415827231999998, 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.932 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.936 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.415400196999997, 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:10.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:10.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 77.957420104999997, 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:10.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:10.947 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.947 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.947 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711968200000001, 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:10.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:10.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.953 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711852930999996, 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:10.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.959 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711821130000004, 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:10.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:10.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711764365999997, 2024-06-11T16:00:10.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:10.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:10.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711737864, 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:10.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:10.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711708817000002, 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.977 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:10.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:10.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711657759000005, 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.983 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:10.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:10.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.988 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.711606126000007, 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:10.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.705424039999997, 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.993 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:10.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:10.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.701102532999997, 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:10.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:10.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:11.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.700926718999995, 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:11.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:11.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.700858569999994, 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:11.007 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:11.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:11.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.700799028000006, 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:11.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:11.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:11.016 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:11.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.018+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.018 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:11.026 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 47, 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T16:00:09.733202+0000", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:59:55.393491+0000", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-06-11T16:00:11.027 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T16:00:11.028 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:11.029 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T16:00:11.030 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:11.031 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:11.032 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:11.033 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.034 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T16:00:11.035 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:11.036 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:11.037 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:11.038 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:11.039 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:11.040 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable", 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T16:00:11.041 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:11.042 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T16:00:11.043 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:11.044 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:11.045 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T16:00:11.046 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable", 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T16:00:11.047 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T16:00:11.048 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:11.049 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:11.050 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:11.051 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:11.052 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable", 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.053 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 46, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:11.054 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.055 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.056 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.057 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.058 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:11.059 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.060 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.061 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:11.062 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.063 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.064 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T16:00:11.065 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0.233062744140625, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 33, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 38, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.066 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:11.067 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.068 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.069 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.070 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:11.071 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:11.072 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 37 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T16:00:11.073 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T16:00:11.074 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:11.075 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:00:11.077 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T16:00:09.733202+0000', 'last_up_change': '2024-06-11T15:59:55.393491+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 0, 'in': 1, 'weight': 0.233062744140625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 38, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T16:00:11.077 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-06-11T16:00:11.118 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:11.118+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:11.126 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:11.126 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:11.126 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:11.126 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:11.135 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:11.220 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:11.220+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:11.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:11.280 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:11.280 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:11.280 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:11.280 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:11.280 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:11.289 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:11.330 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:11.330+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:11.367 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:11.368 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:11.386 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:11.386 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:11.386 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:11.389 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:11.389 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:11.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.421+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.435 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:11.435 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:11.445 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:11.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.522+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.554 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:11.554 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:11.563 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:11.623 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:11.623+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:11.707 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:11.707 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:11.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:11.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:00:11.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.760+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.820 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:11.820 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:11.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.825+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.829 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:11.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:11.926+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:11.935 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:11.935 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:11.944 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:12.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:12.027+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:12.048 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.048 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.057 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:12.127 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:12.127+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:12.162 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.162 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.171 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:12.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:12.228+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:12.278 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.278 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.287 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:12.329 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:12.329+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:12.431 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:12.431+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:12.434 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.434 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:12.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:12.532+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:12.548 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.548 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.557 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:12.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:12.633+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:12.662 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.662 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.671 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:12.733 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:12.733+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:12.759 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:00:12.777 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.778 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.787 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:12.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:12.835+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:12.932 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:12.933 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:12.935 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:12.934+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:12.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:13.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-06-11T16:00:13.036 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.036+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.046 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:13.047 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:13.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:13.136 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.137+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.161 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:13.161 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:13.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:13.237 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.237+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.276 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:13.276 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:13.285 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:13.338 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.338+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:13.394 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:13.394 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:13.402 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:13.443 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.443+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.514 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:13.514 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:13.533 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:13.533 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:13.533 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:13.536 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:13.537 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:13.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:13.539+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:13.546 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:13.547 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:13.555 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:13.639 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.639+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464946233999996, 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:13.662 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:13.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:13.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:13.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464789244000002, 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.668 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:13.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:13.673 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464748834999995, 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:13.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464675115999995, 2024-06-11T16:00:13.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:13.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:13.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464537656000005, 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.685 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:13.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:13.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.690 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464503852999997, 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:13.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:13.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464199058000005, 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:13.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464116797000003, 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.701 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:13.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.464075274999999, 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:13.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.463123369000002, 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.710 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:13.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.463056492999996, 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:13.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:13.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:13.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.462740941000007, 2024-06-11T16:00:13.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:13.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:13.723 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.462195793000006, 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:13.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.461855834000005, 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.728 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:13.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.732 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.459339125, 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:13.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 72.466185279000001, 2024-06-11T16:00:13.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:13.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.464202552000003, 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:13.743 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:13.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 47.463283554999997, 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.749 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 6.923743881, 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:13.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:13.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 6.9130564440000004, 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:13.759 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:13.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:13.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:13.763 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:13.765 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:13.765 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.765+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.866 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.866+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.872 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:13.872 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:13.873 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:13.873 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:13.881 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:13.967 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:13.966+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:13.985 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:13.985 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:13.985 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:13.986 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:13.986 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:13.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:14.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:14.068+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:14.101 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.618464426000003, 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.102 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:14.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.617903162999994, 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:14.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:14.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.615637136999993, 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:14.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:14.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:14.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.615082928000007, 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:14.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.607874045000003, 2024-06-11T16:00:14.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:14.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:14.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.607447010000001, 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:14.127 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:14.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:14.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:14.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.149466918000002, 2024-06-11T16:00:14.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:14.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:14.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.904015013000006, 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:14.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:14.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:14.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903899744, 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:14.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:14.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903867942999995, 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.149 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:14.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903811179000002, 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:14.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:14.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903784677000004, 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:14.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:14.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903755630000006, 2024-06-11T16:00:14.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:14.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:14.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903704571999995, 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:14.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:14.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.903652938999997, 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:14.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:14.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.897470853000002, 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:14.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.893149346000001, 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:14.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.892973531999999, 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.191 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:14.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.892905382999999, 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:14.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:14.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.892845840999996, 2024-06-11T16:00:14.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:14.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:14.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:14.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:14.205 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:14.205 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:14.206 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:14.207 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.206+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.307 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.307+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.316 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:14.316 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:14.316 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:14.317 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to '3f51ea3944d39ca13aa40153c9a4ee298306679d'. 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.317 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:14.318 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at 3f51ea3944d Merge PR #57358 into squid 2024-06-11T16:00:14.321 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-11T16:00:14.326 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:14.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:14.409+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:14.471 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:14.471 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:14.471 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:14.471 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:14.471 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:14.480 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:14.524 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.524+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.540 INFO:tasks.workunit.client.0.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-11T16:00:14.542 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-11T16:00:14.542 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390450623999996, 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.587 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:14.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:14.592 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390293634000002, 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:14.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:14.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390253224999995, 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:14.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:14.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.604 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390179505999996, 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:14.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:14.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.610 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390042046000005, 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:14.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.390008242999997, 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.616 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:14.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:14.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.621 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.389703448000006, 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:14.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.389621187000003, 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.630 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:14.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:14.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.636 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.389579664999999, 2024-06-11T16:00:14.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:14.642 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.388627759000002, 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:14.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:14.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.388560882999997, 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:14.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.388245330999993, 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.652 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:14.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:14.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.387700183000007, 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:14.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.660 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.387360224000005, 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:14.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:14.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 75.384843515, 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.665 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 73.391689669000002, 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:14.669 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:14.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:14.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 54.389706941999997, 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.675 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:14.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:14.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 48.388787944999997, 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:14.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:14.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:14.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.8492482710000004, 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:14.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:14.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.8385608339999999, 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:14.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:14.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:14.695 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:14.696 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:14.697 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.697+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:00:14.797 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.797+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.804 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:14.804 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:14.804 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:14.804 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:14.813 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:14.898 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.899+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:14.917 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:14.917 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:14.917 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:14.917 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:14.917 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:14.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:14.999 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:14.999+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:15.033 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.550497249000003, 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.034 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:15.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.038 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.549935985999994, 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:15.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:15.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.547669959999993, 2024-06-11T16:00:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:15.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:15.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:15.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.547115751000007, 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.048 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:15.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:15.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.539906868000003, 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:15.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:15.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.057 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.539479833000001, 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:15.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:15.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:15.062 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 82.081499741000002, 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:15.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:15.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.836047836000006, 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:15.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:15.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:15.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835932567, 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:15.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835900765999995, 2024-06-11T16:00:15.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:15.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835844002000002, 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.084 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:15.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:15.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.089 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835817500000005, 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:15.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:15.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:15.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835788453000006, 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.095 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:15.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:15.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835737394999995, 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:15.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:15.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.835685761999997, 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:15.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.829503676000002, 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:15.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:15.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.825182169000001, 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:15.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.825006354999999, 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:15.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.824938205999999, 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:15.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:15.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.824878663999996, 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:15.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:15.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:15.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:15.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:15.133 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:15.134 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-11T16:00:15.134 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:15.135+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:15.135 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:15.178 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-11T16:00:15.217 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-11T16:00:15.219 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-11T16:00:15.219 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-11T16:00:15.235 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:15.235+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:15.245 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:15.246 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:15.246 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:15.246 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:15.255 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:15.257 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-11T16:00:15.260 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T16:00:15.260 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-11T16:00:15.276 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-06-11T16:00:15.278 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-06-11T16:00:15.278 DEBUG:teuthology.orchestra.run.smithi089:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f51ea3944d39ca13aa40153c9a4ee298306679d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-06-11T16:00:15.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:15.336+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:15.338 INFO:tasks.workunit.client.0.smithi089.stderr:+ set -e 2024-06-11T16:00:15.338 INFO:tasks.workunit.client.0.smithi089.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-06-11T16:00:15.340 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into 'xfstests-dev'... 2024-06-11T16:00:15.400 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:15.400 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:15.400 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:15.400 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:15.401 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:15.410 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:15.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:15.439+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.319140434000005, 2024-06-11T16:00:15.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:15.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318983443999997, 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:15.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:15.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318943035000004, 2024-06-11T16:00:15.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:15.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318869316000004, 2024-06-11T16:00:15.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:15.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:15.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:15.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318731855999999, 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:15.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.545 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318698053000006, 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:15.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:15.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:15.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:15.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318393258, 2024-06-11T16:00:15.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:15.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.555 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318310996999998, 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.557 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:15.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.318269474999994, 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.560 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:15.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:15.564 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.317317568999997, 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:15.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.317250693000005, 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.316935141000002, 2024-06-11T16:00:15.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:15.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:15.578 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.316389993000001, 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:15.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.316050034, 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:15.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:15.587 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.313533324999995, 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:15.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 74.320379478999996, 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:15.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:15.597 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 55.318396751999998, 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:15.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:15.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:15.603 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 49.317477754999999, 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:15.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:15.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.609 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.7779380810000003, 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:15.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.613 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.7672506440000006, 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:15.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:15.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:15.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:15.618 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:15.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:15.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:15.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:15.620+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:15.720 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:15.721+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:15.728 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:15.728 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:15.728 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:15.728 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:15.737 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:15.740 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:15.740 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:15.759 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:15.759 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:15.760 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:15.762 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:15.762 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:15.773 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:00:15.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:15.822+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:15.845 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:15.845 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:15.853 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:15.922 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:15.922+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:15.998 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:15.998 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.006 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:16.050 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.051+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:16.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:16.078 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-06-11T16:00:16.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T16:00:16.112 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.112 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.121 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:16.162 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.163+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.224 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.224+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.266 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.266 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.274 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:16.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:16.325+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 49, 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T16:00:15.765644+0000", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:59:55.393491+0000", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T16:00:16.363 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5799936, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T16:00:16.364 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:16.365 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:16.366 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:16.367 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:16.368 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:16.369 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.370 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.371 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:16.372 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:16.373 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:16.374 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:16.375 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:16.376 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable", 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.377 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:16.378 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:16.379 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:16.380 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:16.381 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:16.382 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T16:00:16.383 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable", 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:16.384 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T16:00:16.385 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:16.386 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:16.387 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.388 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T16:00:16.389 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable", 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:16.390 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 46, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:16.391 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.392 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.393 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.394 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T16:00:16.395 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.396 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.397 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:16.398 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.399 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.400 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T16:00:16.402 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0.233062744140625, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 33, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 38, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.403 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.404 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.405 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:16.406 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.407 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:16.408 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:16.409 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 37 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:16.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T16:00:16.411 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T16:00:16.412 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:16.413 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:00:16.414 INFO:tasks.thrashosds.thrasher:j is {'epoch': 49, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T16:00:15.765644+0000', 'last_up_change': '2024-06-11T15:59:55.393491+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 0, 'in': 1, 'weight': 0.233062744140625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 38, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T16:00:16.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:00:16.419 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.419 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.425 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.426+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.428 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:16.527 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.527+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.537 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.537 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.546 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:16.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:16.628+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:16.652 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.652 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.662 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:16.704 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:16.706 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:00:16.714 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-06-11T16:00:15.778204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597718,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":591020,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":191,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94844,"kb_used_data":1296,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020676,"statfs":{"total":289910292480,"available":289813172224,"internally_reserved":0,"allocated":1327104,"data_stored":2270401,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":4784,"internal_metadata":95743312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.188624"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767223+0000","last_change":"2024-06-11T15:59:29.308333+0000","last_active":"2024-06-11T16:00:12.767223+0000","last_peered":"2024-06-11T16:00:12.767223+0000","last_clean":"2024-06-11T16:00:12.767223+0000","last_became_active":"2024-06-11T15:59:29.307745+0000","last_became_peered":"2024-06-11T15:59:29.307745+0000","last_unstale":"2024-06-11T16:00:12.767223+0000","last_undegraded":"2024-06-11T16:00:12.767223+0000","last_fullsized":"2024-06-11T16:00:12.767223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766963+0000","last_change":"2024-06-11T15:59:47.370239+0000","last_active":"2024-06-11T16:00:12.766963+0000","last_peered":"2024-06-11T16:00:12.766963+0000","last_clean":"2024-06-11T16:00:12.766963+0000","last_became_active":"2024-06-11T15:59:47.370069+0000","last_became_peered":"2024-06-11T15:59:47.370069+0000","last_unstale":"2024-06-11T16:00:12.766963+0000","last_undegraded":"2024-06-11T16:00:12.766963+0000","last_fullsized":"2024-06-11T16:00:12.766963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:09:08.885403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767079+0000","last_change":"2024-06-11T16:00:06.729026+0000","last_active":"2024-06-11T16:00:12.767079+0000","last_peered":"2024-06-11T16:00:12.767079+0000","last_clean":"2024-06-11T16:00:12.767079+0000","last_became_active":"2024-06-11T16:00:06.726323+0000","last_became_peered":"2024-06-11T16:00:06.726323+0000","last_unstale":"2024-06-11T16:00:12.767079+0000","last_undegraded":"2024-06-11T16:00:12.767079+0000","last_fullsized":"2024-06-11T16:00:12.767079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:02.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766355+0000","last_change":"2024-06-11T16:00:06.729277+0000","last_active":"2024-06-11T16:00:12.766355+0000","last_peered":"2024-06-11T16:00:12.766355+0000","last_clean":"2024-06-11T16:00:12.766355+0000","last_became_active":"2024-06-11T16:00:06.726878+0000","last_became_peered":"2024-06-11T16:00:06.726878+0000","last_unstale":"2024-06-11T16:00:12.766355+0000","last_undegraded":"2024-06-11T16:00:12.766355+0000","last_fullsized":"2024-06-11T16:00:12.766355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:08.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766071+0000","last_change":"2024-06-11T15:59:29.308058+0000","last_active":"2024-06-11T16:00:12.766071+0000","last_peered":"2024-06-11T16:00:12.766071+0000","last_clean":"2024-06-11T16:00:12.766071+0000","last_became_active":"2024-06-11T15:59:29.307440+0000","last_became_peered":"2024-06-11T15:59:29.307440+0000","last_unstale":"2024-06-11T16:00:12.766071+0000","last_undegraded":"2024-06-11T16:00:12.766071+0000","last_fullsized":"2024-06-11T16:00:12.766071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:33:54.815101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765719+0000","last_change":"2024-06-11T16:00:06.731814+0000","last_active":"2024-06-11T16:00:12.765719+0000","last_peered":"2024-06-11T16:00:12.765719+0000","last_clean":"2024-06-11T16:00:12.765719+0000","last_became_active":"2024-06-11T16:00:06.730988+0000","last_became_peered":"2024-06-11T16:00:06.730988+0000","last_unstale":"2024-06-11T16:00:12.765719+0000","last_undegraded":"2024-06-11T16:00:12.765719+0000","last_fullsized":"2024-06-11T16:00:12.765719+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:29.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765651+0000","last_change":"2024-06-11T16:00:06.732910+0000","last_active":"2024-06-11T16:00:12.765651+0000","last_peered":"2024-06-11T16:00:12.765651+0000","last_clean":"2024-06-11T16:00:12.765651+0000","last_became_active":"2024-06-11T16:00:06.732336+0000","last_became_peered":"2024-06-11T16:00:06.732336+0000","last_unstale":"2024-06-11T16:00:12.765651+0000","last_undegraded":"2024-06-11T16:00:12.765651+0000","last_fullsized":"2024-06-11T16:00:12.765651+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:36.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765858+0000","last_change":"2024-06-11T16:00:06.731388+0000","last_active":"2024-06-11T16:00:12.765858+0000","last_peered":"2024-06-11T16:00:12.765858+0000","last_clean":"2024-06-11T16:00:12.765858+0000","last_became_active":"2024-06-11T16:00:06.730852+0000","last_became_peered":"2024-06-11T16:00:06.730852+0000","last_unstale":"2024-06-11T16:00:12.765858+0000","last_undegraded":"2024-06-11T16:00:12.765858+0000","last_fullsized":"2024-06-11T16:00:12.765858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:52:32.141371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766820+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:00:12.766820+0000","last_peered":"2024-06-11T16:00:12.766820+0000","last_clean":"2024-06-11T16:00:12.766820+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:00:12.766820+0000","last_undegraded":"2024-06-11T16:00:12.766820+0000","last_fullsized":"2024-06-11T16:00:12.766820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766958+0000","last_change":"2024-06-11T15:59:47.370396+0000","last_active":"2024-06-11T16:00:12.766958+0000","last_peered":"2024-06-11T16:00:12.766958+0000","last_clean":"2024-06-11T16:00:12.766958+0000","last_became_active":"2024-06-11T15:59:47.370113+0000","last_became_peered":"2024-06-11T15:59:47.370113+0000","last_unstale":"2024-06-11T16:00:12.766958+0000","last_undegraded":"2024-06-11T16:00:12.766958+0000","last_fullsized":"2024-06-11T16:00:12.766958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:05:42.545025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.767208+0000","last_change":"2024-06-11T15:59:56.404790+0000","last_active":"2024-06-11T16:00:12.767208+0000","last_peered":"2024-06-11T16:00:12.767208+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404790+0000","last_became_peered":"2024-06-11T15:59:56.404790+0000","last_unstale":"2024-06-11T16:00:12.767208+0000","last_undegraded":"2024-06-11T16:00:12.767208+0000","last_fullsized":"2024-06-11T15:59:56.401805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:59:59.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766207+0000","last_change":"2024-06-11T16:00:06.726442+0000","last_active":"2024-06-11T16:00:12.766207+0000","last_peered":"2024-06-11T16:00:12.766207+0000","last_clean":"2024-06-11T16:00:12.766207+0000","last_became_active":"2024-06-11T16:00:06.725937+0000","last_became_peered":"2024-06-11T16:00:06.725937+0000","last_unstale":"2024-06-11T16:00:12.766207+0000","last_undegraded":"2024-06-11T16:00:12.766207+0000","last_fullsized":"2024-06-11T16:00:12.766207+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:25:12.722872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766103+0000","last_change":"2024-06-11T15:59:29.308484+0000","last_active":"2024-06-11T16:00:12.766103+0000","last_peered":"2024-06-11T16:00:12.766103+0000","last_clean":"2024-06-11T16:00:12.766103+0000","last_became_active":"2024-06-11T15:59:29.308104+0000","last_became_peered":"2024-06-11T15:59:29.308104+0000","last_unstale":"2024-06-11T16:00:12.766103+0000","last_undegraded":"2024-06-11T16:00:12.766103+0000","last_fullsized":"2024-06-11T16:00:12.766103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766122+0000","last_change":"2024-06-11T15:59:56.403777+0000","last_active":"2024-06-11T16:00:12.766122+0000","last_peered":"2024-06-11T16:00:12.766122+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403777+0000","last_became_peered":"2024-06-11T15:59:56.403777+0000","last_unstale":"2024-06-11T16:00:12.766122+0000","last_undegraded":"2024-06-11T16:00:12.766122+0000","last_fullsized":"2024-06-11T15:59:56.400876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765577+0000","last_change":"2024-06-11T16:00:06.731309+0000","last_active":"2024-06-11T16:00:12.765577+0000","last_peered":"2024-06-11T16:00:12.765577+0000","last_clean":"2024-06-11T16:00:12.765577+0000","last_became_active":"2024-06-11T16:00:06.729334+0000","last_became_peered":"2024-06-11T16:00:06.729334+0000","last_unstale":"2024-06-11T16:00:12.765577+0000","last_undegraded":"2024-06-11T16:00:12.765577+0000","last_fullsized":"2024-06-11T16:00:12.765577+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:29.047874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.765716+0000","last_change":"2024-06-11T15:59:56.403626+0000","last_active":"2024-06-11T16:00:12.765716+0000","last_peered":"2024-06-11T16:00:12.765716+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403626+0000","last_became_peered":"2024-06-11T15:59:56.403626+0000","last_unstale":"2024-06-11T16:00:12.765716+0000","last_undegraded":"2024-06-11T16:00:12.765716+0000","last_fullsized":"2024-06-11T15:59:56.401170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:06:39.398270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767309+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:00:12.767309+0000","last_peered":"2024-06-11T16:00:12.767309+0000","last_clean":"2024-06-11T16:00:12.767309+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:00:12.767309+0000","last_undegraded":"2024-06-11T16:00:12.767309+0000","last_fullsized":"2024-06-11T16:00:12.767309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767297+0000","last_change":"2024-06-11T15:59:47.370615+0000","last_active":"2024-06-11T16:00:12.767297+0000","last_peered":"2024-06-11T16:00:12.767297+0000","last_clean":"2024-06-11T16:00:12.767297+0000","last_became_active":"2024-06-11T15:59:47.370447+0000","last_became_peered":"2024-06-11T15:59:47.370447+0000","last_unstale":"2024-06-11T16:00:12.767297+0000","last_undegraded":"2024-06-11T16:00:12.767297+0000","last_fullsized":"2024-06-11T16:00:12.767297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.896374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.768509+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:00:12.768509+0000","last_peered":"2024-06-11T16:00:12.768509+0000","last_clean":"2024-06-11T16:00:12.768509+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:00:12.768509+0000","last_undegraded":"2024-06-11T16:00:12.768509+0000","last_fullsized":"2024-06-11T16:00:12.768509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766304+0000","last_change":"2024-06-11T15:59:56.405841+0000","last_active":"2024-06-11T16:00:12.766304+0000","last_peered":"2024-06-11T16:00:12.766304+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405841+0000","last_became_peered":"2024-06-11T15:59:56.405841+0000","last_unstale":"2024-06-11T16:00:12.766304+0000","last_undegraded":"2024-06-11T16:00:12.766304+0000","last_fullsized":"2024-06-11T15:59:56.402278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:11:45.362411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766415+0000","last_change":"2024-06-11T16:00:06.735178+0000","last_active":"2024-06-11T16:00:12.766415+0000","last_peered":"2024-06-11T16:00:12.766415+0000","last_clean":"2024-06-11T16:00:12.766415+0000","last_became_active":"2024-06-11T16:00:06.734286+0000","last_became_peered":"2024-06-11T16:00:06.734286+0000","last_unstale":"2024-06-11T16:00:12.766415+0000","last_undegraded":"2024-06-11T16:00:12.766415+0000","last_fullsized":"2024-06-11T16:00:12.766415+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:17:57.781743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765623+0000","last_change":"2024-06-11T16:00:06.730806+0000","last_active":"2024-06-11T16:00:12.765623+0000","last_peered":"2024-06-11T16:00:12.765623+0000","last_clean":"2024-06-11T16:00:12.765623+0000","last_became_active":"2024-06-11T16:00:06.729901+0000","last_became_peered":"2024-06-11T16:00:06.729901+0000","last_unstale":"2024-06-11T16:00:12.765623+0000","last_undegraded":"2024-06-11T16:00:12.765623+0000","last_fullsized":"2024-06-11T16:00:12.765623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:29:29.093801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765800+0000","last_change":"2024-06-11T16:00:06.733583+0000","last_active":"2024-06-11T16:00:12.765800+0000","last_peered":"2024-06-11T16:00:12.765800+0000","last_clean":"2024-06-11T16:00:12.765800+0000","last_became_active":"2024-06-11T16:00:06.733040+0000","last_became_peered":"2024-06-11T16:00:06.733040+0000","last_unstale":"2024-06-11T16:00:12.765800+0000","last_undegraded":"2024-06-11T16:00:12.765800+0000","last_fullsized":"2024-06-11T16:00:12.765800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:21.984919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765906+0000","last_change":"2024-06-11T15:59:29.303643+0000","last_active":"2024-06-11T16:00:12.765906+0000","last_peered":"2024-06-11T16:00:12.765906+0000","last_clean":"2024-06-11T16:00:12.765906+0000","last_became_active":"2024-06-11T15:59:29.303337+0000","last_became_peered":"2024-06-11T15:59:29.303337+0000","last_unstale":"2024-06-11T16:00:12.765906+0000","last_undegraded":"2024-06-11T16:00:12.765906+0000","last_fullsized":"2024-06-11T16:00:12.765906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:10:30.771690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766766+0000","last_change":"2024-06-11T16:00:06.726945+0000","last_active":"2024-06-11T16:00:12.766766+0000","last_peered":"2024-06-11T16:00:12.766766+0000","last_clean":"2024-06-11T16:00:12.766766+0000","last_became_active":"2024-06-11T16:00:06.726670+0000","last_became_peered":"2024-06-11T16:00:06.726670+0000","last_unstale":"2024-06-11T16:00:12.766766+0000","last_undegraded":"2024-06-11T16:00:12.766766+0000","last_fullsized":"2024-06-11T16:00:12.766766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:52:48.804955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767181+0000","last_change":"2024-06-11T16:00:06.730881+0000","last_active":"2024-06-11T16:00:12.767181+0000","last_peered":"2024-06-11T16:00:12.767181+0000","last_clean":"2024-06-11T16:00:12.767181+0000","last_became_active":"2024-06-11T16:00:06.730331+0000","last_became_peered":"2024-06-11T16:00:06.730331+0000","last_unstale":"2024-06-11T16:00:12.767181+0000","last_undegraded":"2024-06-11T16:00:12.767181+0000","last_fullsized":"2024-06-11T16:00:12.767181+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:59.680982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.768605+0000","last_change":"2024-06-11T16:00:06.732040+0000","last_active":"2024-06-11T16:00:12.768605+0000","last_peered":"2024-06-11T16:00:12.768605+0000","last_clean":"2024-06-11T16:00:12.768605+0000","last_became_active":"2024-06-11T16:00:06.729809+0000","last_became_peered":"2024-06-11T16:00:06.729809+0000","last_unstale":"2024-06-11T16:00:12.768605+0000","last_undegraded":"2024-06-11T16:00:12.768605+0000","last_fullsized":"2024-06-11T16:00:12.768605+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:40:14.285364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":61,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766800+0000","last_change":"2024-06-11T15:59:56.404272+0000","last_active":"2024-06-11T16:00:12.766800+0000","last_peered":"2024-06-11T16:00:12.766800+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404272+0000","last_became_peered":"2024-06-11T15:59:56.404272+0000","last_unstale":"2024-06-11T16:00:12.766800+0000","last_undegraded":"2024-06-11T16:00:12.766800+0000","last_fullsized":"2024-06-11T15:59:56.401760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:28.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766317+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:00:12.766317+0000","last_peered":"2024-06-11T16:00:12.766317+0000","last_clean":"2024-06-11T16:00:12.766317+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:00:12.766317+0000","last_undegraded":"2024-06-11T16:00:12.766317+0000","last_fullsized":"2024-06-11T16:00:12.766317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765789+0000","last_change":"2024-06-11T16:00:06.728137+0000","last_active":"2024-06-11T16:00:12.765789+0000","last_peered":"2024-06-11T16:00:12.765789+0000","last_clean":"2024-06-11T16:00:12.765789+0000","last_became_active":"2024-06-11T16:00:06.727573+0000","last_became_peered":"2024-06-11T16:00:06.727573+0000","last_unstale":"2024-06-11T16:00:12.765789+0000","last_undegraded":"2024-06-11T16:00:12.765789+0000","last_fullsized":"2024-06-11T16:00:12.765789+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:33:27.695484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765753+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:00:12.765753+0000","last_peered":"2024-06-11T16:00:12.765753+0000","last_clean":"2024-06-11T16:00:12.765753+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:00:12.765753+0000","last_undegraded":"2024-06-11T16:00:12.765753+0000","last_fullsized":"2024-06-11T16:00:12.765753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765577+0000","last_change":"2024-06-11T16:00:06.731265+0000","last_active":"2024-06-11T16:00:12.765577+0000","last_peered":"2024-06-11T16:00:12.765577+0000","last_clean":"2024-06-11T16:00:12.765577+0000","last_became_active":"2024-06-11T16:00:06.730460+0000","last_became_peered":"2024-06-11T16:00:06.730460+0000","last_unstale":"2024-06-11T16:00:12.765577+0000","last_undegraded":"2024-06-11T16:00:12.765577+0000","last_fullsized":"2024-06-11T16:00:12.765577+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:54.914172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766477+0000","last_change":"2024-06-11T15:59:29.307780+0000","last_active":"2024-06-11T16:00:12.766477+0000","last_peered":"2024-06-11T16:00:12.766477+0000","last_clean":"2024-06-11T16:00:12.766477+0000","last_became_active":"2024-06-11T15:59:29.307475+0000","last_became_peered":"2024-06-11T15:59:29.307475+0000","last_unstale":"2024-06-11T16:00:12.766477+0000","last_undegraded":"2024-06-11T16:00:12.766477+0000","last_fullsized":"2024-06-11T16:00:12.766477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:04.032746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":37,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:12.766166+0000","last_change":"2024-06-11T15:59:56.404452+0000","last_active":"2024-06-11T16:00:12.766166+0000","last_peered":"2024-06-11T16:00:12.766166+0000","last_clean":"2024-06-11T15:58:59.196469+0000","last_became_active":"2024-06-11T15:59:56.404452+0000","last_became_peered":"2024-06-11T15:59:56.404452+0000","last_unstale":"2024-06-11T16:00:12.766166+0000","last_undegraded":"2024-06-11T15:59:56.401901+0000","last_fullsized":"2024-06-11T15:59:56.401811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:57:31.951964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767378+0000","last_change":"2024-06-11T15:59:29.308260+0000","last_active":"2024-06-11T16:00:12.767378+0000","last_peered":"2024-06-11T16:00:12.767378+0000","last_clean":"2024-06-11T16:00:12.767378+0000","last_became_active":"2024-06-11T15:59:29.307521+0000","last_became_peered":"2024-06-11T15:59:29.307521+0000","last_unstale":"2024-06-11T16:00:12.767378+0000","last_undegraded":"2024-06-11T16:00:12.767378+0000","last_fullsized":"2024-06-11T16:00:12.767378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:33.415958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766206+0000","last_change":"2024-06-11T15:59:56.404430+0000","last_active":"2024-06-11T16:00:12.766206+0000","last_peered":"2024-06-11T16:00:12.766206+0000","last_clean":"2024-06-11T15:59:54.394866+0000","last_became_active":"2024-06-11T15:59:56.404430+0000","last_became_peered":"2024-06-11T15:59:56.404430+0000","last_unstale":"2024-06-11T16:00:12.766206+0000","last_undegraded":"2024-06-11T16:00:12.766206+0000","last_fullsized":"2024-06-11T15:59:56.401724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:31.755176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.767388+0000","last_change":"2024-06-11T15:59:56.407801+0000","last_active":"2024-06-11T16:00:12.767388+0000","last_peered":"2024-06-11T16:00:12.767388+0000","last_clean":"2024-06-11T15:59:54.395491+0000","last_became_active":"2024-06-11T15:59:56.407801+0000","last_became_peered":"2024-06-11T15:59:56.407801+0000","last_unstale":"2024-06-11T16:00:12.767388+0000","last_undegraded":"2024-06-11T16:00:12.767388+0000","last_fullsized":"2024-06-11T15:59:56.404860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.264606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765510+0000","last_change":"2024-06-11T16:00:06.732106+0000","last_active":"2024-06-11T16:00:12.765510+0000","last_peered":"2024-06-11T16:00:12.765510+0000","last_clean":"2024-06-11T16:00:12.765510+0000","last_became_active":"2024-06-11T16:00:06.729443+0000","last_became_peered":"2024-06-11T16:00:06.729443+0000","last_unstale":"2024-06-11T16:00:12.765510+0000","last_undegraded":"2024-06-11T16:00:12.765510+0000","last_fullsized":"2024-06-11T16:00:12.765510+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T15:59:04.675026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766863+0000","last_change":"2024-06-11T15:59:56.405353+0000","last_active":"2024-06-11T16:00:12.766863+0000","last_peered":"2024-06-11T16:00:12.766863+0000","last_clean":"2024-06-11T15:59:54.395399+0000","last_became_active":"2024-06-11T15:59:56.405353+0000","last_became_peered":"2024-06-11T15:59:56.405353+0000","last_unstale":"2024-06-11T16:00:12.766863+0000","last_undegraded":"2024-06-11T16:00:12.766863+0000","last_fullsized":"2024-06-11T15:59:56.402136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:36.827812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":28,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765465+0000","last_change":"2024-06-11T16:00:06.750390+0000","last_active":"2024-06-11T16:00:12.765465+0000","last_peered":"2024-06-11T16:00:12.765465+0000","last_clean":"2024-06-11T16:00:12.765465+0000","last_became_active":"2024-06-11T16:00:06.730127+0000","last_became_peered":"2024-06-11T16:00:06.730127+0000","last_unstale":"2024-06-11T16:00:12.765465+0000","last_undegraded":"2024-06-11T16:00:12.765465+0000","last_fullsized":"2024-06-11T16:00:12.765465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:47.680585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":37,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:12.766749+0000","last_change":"2024-06-11T15:59:56.404250+0000","last_active":"2024-06-11T16:00:12.766749+0000","last_peered":"2024-06-11T16:00:12.766749+0000","last_clean":"2024-06-11T15:58:59.195790+0000","last_became_active":"2024-06-11T15:59:56.404250+0000","last_became_peered":"2024-06-11T15:59:56.404250+0000","last_unstale":"2024-06-11T16:00:12.766749+0000","last_undegraded":"2024-06-11T15:59:56.401382+0000","last_fullsized":"2024-06-11T15:59:56.401309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:59:20.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.765936+0000","last_change":"2024-06-11T15:59:56.403389+0000","last_active":"2024-06-11T16:00:12.765936+0000","last_peered":"2024-06-11T16:00:12.765936+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403389+0000","last_became_peered":"2024-06-11T15:59:56.403389+0000","last_unstale":"2024-06-11T16:00:12.765936+0000","last_undegraded":"2024-06-11T16:00:12.765936+0000","last_fullsized":"2024-06-11T15:59:56.400803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767210+0000","last_change":"2024-06-11T16:00:06.759672+0000","last_active":"2024-06-11T16:00:12.767210+0000","last_peered":"2024-06-11T16:00:12.767210+0000","last_clean":"2024-06-11T16:00:12.767210+0000","last_became_active":"2024-06-11T16:00:06.732503+0000","last_became_peered":"2024-06-11T16:00:06.732503+0000","last_unstale":"2024-06-11T16:00:12.767210+0000","last_undegraded":"2024-06-11T16:00:12.767210+0000","last_fullsized":"2024-06-11T16:00:12.767210+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765927+0000","last_change":"2024-06-11T15:59:29.305115+0000","last_active":"2024-06-11T16:00:12.765927+0000","last_peered":"2024-06-11T16:00:12.765927+0000","last_clean":"2024-06-11T16:00:12.765927+0000","last_became_active":"2024-06-11T15:59:29.304789+0000","last_became_peered":"2024-06-11T15:59:29.304789+0000","last_unstale":"2024-06-11T16:00:12.765927+0000","last_undegraded":"2024-06-11T16:00:12.765927+0000","last_fullsized":"2024-06-11T16:00:12.765927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:08:21.411683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766951+0000","last_change":"2024-06-11T16:00:06.741350+0000","last_active":"2024-06-11T16:00:12.766951+0000","last_peered":"2024-06-11T16:00:12.766951+0000","last_clean":"2024-06-11T16:00:12.766951+0000","last_became_active":"2024-06-11T16:00:06.726679+0000","last_became_peered":"2024-06-11T16:00:06.726679+0000","last_unstale":"2024-06-11T16:00:12.766951+0000","last_undegraded":"2024-06-11T16:00:12.766951+0000","last_fullsized":"2024-06-11T16:00:12.766951+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:59.285822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766416+0000","last_change":"2024-06-11T16:00:06.734561+0000","last_active":"2024-06-11T16:00:12.766416+0000","last_peered":"2024-06-11T16:00:12.766416+0000","last_clean":"2024-06-11T16:00:12.766416+0000","last_became_active":"2024-06-11T16:00:06.734361+0000","last_became_peered":"2024-06-11T16:00:06.734361+0000","last_unstale":"2024-06-11T16:00:12.766416+0000","last_undegraded":"2024-06-11T16:00:12.766416+0000","last_fullsized":"2024-06-11T16:00:12.766416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:32.369019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766773+0000","last_change":"2024-06-11T16:00:06.731134+0000","last_active":"2024-06-11T16:00:12.766773+0000","last_peered":"2024-06-11T16:00:12.766773+0000","last_clean":"2024-06-11T16:00:12.766773+0000","last_became_active":"2024-06-11T16:00:06.727963+0000","last_became_peered":"2024-06-11T16:00:06.727963+0000","last_unstale":"2024-06-11T16:00:12.766773+0000","last_undegraded":"2024-06-11T16:00:12.766773+0000","last_fullsized":"2024-06-11T16:00:12.766773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:50.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766411+0000","last_change":"2024-06-11T16:00:06.736430+0000","last_active":"2024-06-11T16:00:12.766411+0000","last_peered":"2024-06-11T16:00:12.766411+0000","last_clean":"2024-06-11T16:00:12.766411+0000","last_became_active":"2024-06-11T16:00:06.736127+0000","last_became_peered":"2024-06-11T16:00:06.736127+0000","last_unstale":"2024-06-11T16:00:12.766411+0000","last_undegraded":"2024-06-11T16:00:12.766411+0000","last_fullsized":"2024-06-11T16:00:12.766411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:53:27.265136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":85,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766509+0000","last_change":"2024-06-11T16:00:06.762561+0000","last_active":"2024-06-11T16:00:12.766509+0000","last_peered":"2024-06-11T16:00:12.766509+0000","last_clean":"2024-06-11T16:00:12.766509+0000","last_became_active":"2024-06-11T16:00:06.735732+0000","last_became_peered":"2024-06-11T16:00:06.735732+0000","last_unstale":"2024-06-11T16:00:12.766509+0000","last_undegraded":"2024-06-11T16:00:12.766509+0000","last_fullsized":"2024-06-11T16:00:12.766509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:38.902662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766228+0000","last_change":"2024-06-11T16:00:06.729036+0000","last_active":"2024-06-11T16:00:12.766228+0000","last_peered":"2024-06-11T16:00:12.766228+0000","last_clean":"2024-06-11T16:00:12.766228+0000","last_became_active":"2024-06-11T16:00:06.726799+0000","last_became_peered":"2024-06-11T16:00:06.726799+0000","last_unstale":"2024-06-11T16:00:12.766228+0000","last_undegraded":"2024-06-11T16:00:12.766228+0000","last_fullsized":"2024-06-11T16:00:12.766228+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:31.484951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.765946+0000","last_change":"2024-06-11T15:59:56.403784+0000","last_active":"2024-06-11T16:00:12.765946+0000","last_peered":"2024-06-11T16:00:12.765946+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403784+0000","last_became_peered":"2024-06-11T15:59:56.403784+0000","last_unstale":"2024-06-11T16:00:12.765946+0000","last_undegraded":"2024-06-11T16:00:12.765946+0000","last_fullsized":"2024-06-11T15:59:56.401221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766488+0000","last_change":"2024-06-11T16:00:06.731326+0000","last_active":"2024-06-11T16:00:12.766488+0000","last_peered":"2024-06-11T16:00:12.766488+0000","last_clean":"2024-06-11T16:00:12.766488+0000","last_became_active":"2024-06-11T16:00:06.730397+0000","last_became_peered":"2024-06-11T16:00:06.730397+0000","last_unstale":"2024-06-11T16:00:12.766488+0000","last_undegraded":"2024-06-11T16:00:12.766488+0000","last_fullsized":"2024-06-11T16:00:12.766488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:36.033362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.766303+0000","last_change":"2024-06-11T15:59:56.405129+0000","last_active":"2024-06-11T16:00:12.766303+0000","last_peered":"2024-06-11T16:00:12.766303+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.405129+0000","last_became_peered":"2024-06-11T15:59:56.405129+0000","last_unstale":"2024-06-11T16:00:12.766303+0000","last_undegraded":"2024-06-11T16:00:12.766303+0000","last_fullsized":"2024-06-11T15:59:56.402039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766419+0000","last_change":"2024-06-11T16:00:06.729783+0000","last_active":"2024-06-11T16:00:12.766419+0000","last_peered":"2024-06-11T16:00:12.766419+0000","last_clean":"2024-06-11T16:00:12.766419+0000","last_became_active":"2024-06-11T16:00:06.728895+0000","last_became_peered":"2024-06-11T16:00:06.728895+0000","last_unstale":"2024-06-11T16:00:12.766419+0000","last_undegraded":"2024-06-11T16:00:12.766419+0000","last_fullsized":"2024-06-11T16:00:12.766419+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:23:47.804555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765974+0000","last_change":"2024-06-11T15:59:47.370077+0000","last_active":"2024-06-11T16:00:12.765974+0000","last_peered":"2024-06-11T16:00:12.765974+0000","last_clean":"2024-06-11T16:00:12.765974+0000","last_became_active":"2024-06-11T15:59:47.369829+0000","last_became_peered":"2024-06-11T15:59:47.369829+0000","last_unstale":"2024-06-11T16:00:12.765974+0000","last_undegraded":"2024-06-11T16:00:12.765974+0000","last_fullsized":"2024-06-11T16:00:12.765974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:39:16.276410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767020+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:00:12.767020+0000","last_peered":"2024-06-11T16:00:12.767020+0000","last_clean":"2024-06-11T16:00:12.767020+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:00:12.767020+0000","last_undegraded":"2024-06-11T16:00:12.767020+0000","last_fullsized":"2024-06-11T16:00:12.767020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":233,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766741+0000","last_change":"2024-06-11T16:00:09.739640+0000","last_active":"2024-06-11T16:00:12.766741+0000","last_peered":"2024-06-11T16:00:12.766741+0000","last_clean":"2024-06-11T16:00:12.766741+0000","last_became_active":"2024-06-11T16:00:09.739392+0000","last_became_peered":"2024-06-11T16:00:09.739392+0000","last_unstale":"2024-06-11T16:00:12.766741+0000","last_undegraded":"2024-06-11T16:00:12.766741+0000","last_fullsized":"2024-06-11T16:00:12.766741+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:15.633968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766782+0000","last_change":"2024-06-11T16:00:06.736403+0000","last_active":"2024-06-11T16:00:12.766782+0000","last_peered":"2024-06-11T16:00:12.766782+0000","last_clean":"2024-06-11T16:00:12.766782+0000","last_became_active":"2024-06-11T16:00:06.736220+0000","last_became_peered":"2024-06-11T16:00:06.736220+0000","last_unstale":"2024-06-11T16:00:12.766782+0000","last_undegraded":"2024-06-11T16:00:12.766782+0000","last_fullsized":"2024-06-11T16:00:12.766782+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:42.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766905+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:00:12.766905+0000","last_peered":"2024-06-11T16:00:12.766905+0000","last_clean":"2024-06-11T16:00:12.766905+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:00:12.766905+0000","last_undegraded":"2024-06-11T16:00:12.766905+0000","last_fullsized":"2024-06-11T16:00:12.766905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767055+0000","last_change":"2024-06-11T16:00:06.730859+0000","last_active":"2024-06-11T16:00:12.767055+0000","last_peered":"2024-06-11T16:00:12.767055+0000","last_clean":"2024-06-11T16:00:12.767055+0000","last_became_active":"2024-06-11T16:00:06.727651+0000","last_became_peered":"2024-06-11T16:00:06.727651+0000","last_unstale":"2024-06-11T16:00:12.767055+0000","last_undegraded":"2024-06-11T16:00:12.767055+0000","last_fullsized":"2024-06-11T16:00:12.767055+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:27.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765581+0000","last_change":"2024-06-11T16:00:06.728896+0000","last_active":"2024-06-11T16:00:12.765581+0000","last_peered":"2024-06-11T16:00:12.765581+0000","last_clean":"2024-06-11T16:00:12.765581+0000","last_became_active":"2024-06-11T16:00:06.725941+0000","last_became_peered":"2024-06-11T16:00:06.725941+0000","last_unstale":"2024-06-11T16:00:12.765581+0000","last_undegraded":"2024-06-11T16:00:12.765581+0000","last_fullsized":"2024-06-11T16:00:12.765581+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:26.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766022+0000","last_change":"2024-06-11T16:00:06.734401+0000","last_active":"2024-06-11T16:00:12.766022+0000","last_peered":"2024-06-11T16:00:12.766022+0000","last_clean":"2024-06-11T16:00:12.766022+0000","last_became_active":"2024-06-11T16:00:06.733591+0000","last_became_peered":"2024-06-11T16:00:06.733591+0000","last_unstale":"2024-06-11T16:00:12.766022+0000","last_undegraded":"2024-06-11T16:00:12.766022+0000","last_fullsized":"2024-06-11T16:00:12.766022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:53:07.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767111+0000","last_change":"2024-06-11T15:59:29.308305+0000","last_active":"2024-06-11T16:00:12.767111+0000","last_peered":"2024-06-11T16:00:12.767111+0000","last_clean":"2024-06-11T16:00:12.767111+0000","last_became_active":"2024-06-11T15:59:29.307739+0000","last_became_peered":"2024-06-11T15:59:29.307739+0000","last_unstale":"2024-06-11T16:00:12.767111+0000","last_undegraded":"2024-06-11T16:00:12.767111+0000","last_fullsized":"2024-06-11T16:00:12.767111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:37.529774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766265+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:00:12.766265+0000","last_peered":"2024-06-11T16:00:12.766265+0000","last_clean":"2024-06-11T16:00:12.766265+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:00:12.766265+0000","last_undegraded":"2024-06-11T16:00:12.766265+0000","last_fullsized":"2024-06-11T16:00:12.766265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765453+0000","last_change":"2024-06-11T16:00:06.731161+0000","last_active":"2024-06-11T16:00:12.765453+0000","last_peered":"2024-06-11T16:00:12.765453+0000","last_clean":"2024-06-11T16:00:12.765453+0000","last_became_active":"2024-06-11T16:00:06.730198+0000","last_became_peered":"2024-06-11T16:00:06.730198+0000","last_unstale":"2024-06-11T16:00:12.765453+0000","last_undegraded":"2024-06-11T16:00:12.765453+0000","last_fullsized":"2024-06-11T16:00:12.765453+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:50:45.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767129+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:00:12.767129+0000","last_peered":"2024-06-11T16:00:12.767129+0000","last_clean":"2024-06-11T16:00:12.767129+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:00:12.767129+0000","last_undegraded":"2024-06-11T16:00:12.767129+0000","last_fullsized":"2024-06-11T16:00:12.767129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766992+0000","last_change":"2024-06-11T16:00:06.733390+0000","last_active":"2024-06-11T16:00:12.766992+0000","last_peered":"2024-06-11T16:00:12.766992+0000","last_clean":"2024-06-11T16:00:12.766992+0000","last_became_active":"2024-06-11T16:00:06.733129+0000","last_became_peered":"2024-06-11T16:00:06.733129+0000","last_unstale":"2024-06-11T16:00:12.766992+0000","last_undegraded":"2024-06-11T16:00:12.766992+0000","last_fullsized":"2024-06-11T16:00:12.766992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:04:02.257999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766199+0000","last_change":"2024-06-11T16:00:06.735376+0000","last_active":"2024-06-11T16:00:12.766199+0000","last_peered":"2024-06-11T16:00:12.766199+0000","last_clean":"2024-06-11T16:00:12.766199+0000","last_became_active":"2024-06-11T16:00:06.734349+0000","last_became_peered":"2024-06-11T16:00:06.734349+0000","last_unstale":"2024-06-11T16:00:12.766199+0000","last_undegraded":"2024-06-11T16:00:12.766199+0000","last_fullsized":"2024-06-11T16:00:12.766199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:57.761478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766857+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:00:12.766857+0000","last_peered":"2024-06-11T16:00:12.766857+0000","last_clean":"2024-06-11T16:00:12.766857+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:00:12.766857+0000","last_undegraded":"2024-06-11T16:00:12.766857+0000","last_fullsized":"2024-06-11T16:00:12.766857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.768446+0000","last_change":"2024-06-11T15:59:56.403576+0000","last_active":"2024-06-11T16:00:12.768446+0000","last_peered":"2024-06-11T16:00:12.768446+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403576+0000","last_became_peered":"2024-06-11T15:59:56.403576+0000","last_unstale":"2024-06-11T16:00:12.768446+0000","last_undegraded":"2024-06-11T16:00:12.768446+0000","last_fullsized":"2024-06-11T15:59:56.402056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:59:03.781359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767030+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:00:12.767030+0000","last_peered":"2024-06-11T16:00:12.767030+0000","last_clean":"2024-06-11T16:00:12.767030+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:00:12.767030+0000","last_undegraded":"2024-06-11T16:00:12.767030+0000","last_fullsized":"2024-06-11T16:00:12.767030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765699+0000","last_change":"2024-06-11T16:00:06.730456+0000","last_active":"2024-06-11T16:00:12.765699+0000","last_peered":"2024-06-11T16:00:12.765699+0000","last_clean":"2024-06-11T16:00:12.765699+0000","last_became_active":"2024-06-11T16:00:06.729977+0000","last_became_peered":"2024-06-11T16:00:06.729977+0000","last_unstale":"2024-06-11T16:00:12.765699+0000","last_undegraded":"2024-06-11T16:00:12.765699+0000","last_fullsized":"2024-06-11T16:00:12.765699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:55:24.550321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766948+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:00:12.766948+0000","last_peered":"2024-06-11T16:00:12.766948+0000","last_clean":"2024-06-11T16:00:12.766948+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:00:12.766948+0000","last_undegraded":"2024-06-11T16:00:12.766948+0000","last_fullsized":"2024-06-11T16:00:12.766948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.768609+0000","last_change":"2024-06-11T15:59:29.308481+0000","last_active":"2024-06-11T16:00:12.768609+0000","last_peered":"2024-06-11T16:00:12.768609+0000","last_clean":"2024-06-11T16:00:12.768609+0000","last_became_active":"2024-06-11T15:59:29.307986+0000","last_became_peered":"2024-06-11T15:59:29.307986+0000","last_unstale":"2024-06-11T16:00:12.768609+0000","last_undegraded":"2024-06-11T16:00:12.768609+0000","last_fullsized":"2024-06-11T16:00:12.768609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:20.285064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765718+0000","last_change":"2024-06-11T16:00:06.733056+0000","last_active":"2024-06-11T16:00:12.765718+0000","last_peered":"2024-06-11T16:00:12.765718+0000","last_clean":"2024-06-11T16:00:12.765718+0000","last_became_active":"2024-06-11T16:00:06.732005+0000","last_became_peered":"2024-06-11T16:00:06.732005+0000","last_unstale":"2024-06-11T16:00:12.765718+0000","last_undegraded":"2024-06-11T16:00:12.765718+0000","last_fullsized":"2024-06-11T16:00:12.765718+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:56:26.626148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767356+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:00:12.767356+0000","last_peered":"2024-06-11T16:00:12.767356+0000","last_clean":"2024-06-11T16:00:12.767356+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:00:12.767356+0000","last_undegraded":"2024-06-11T16:00:12.767356+0000","last_fullsized":"2024-06-11T16:00:12.767356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.768540+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:00:12.768540+0000","last_peered":"2024-06-11T16:00:12.768540+0000","last_clean":"2024-06-11T16:00:12.768540+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:00:12.768540+0000","last_undegraded":"2024-06-11T16:00:12.768540+0000","last_fullsized":"2024-06-11T16:00:12.768540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766132+0000","last_change":"2024-06-11T16:00:06.733052+0000","last_active":"2024-06-11T16:00:12.766132+0000","last_peered":"2024-06-11T16:00:12.766132+0000","last_clean":"2024-06-11T16:00:12.766132+0000","last_became_active":"2024-06-11T16:00:06.730909+0000","last_became_peered":"2024-06-11T16:00:06.730909+0000","last_unstale":"2024-06-11T16:00:12.766132+0000","last_undegraded":"2024-06-11T16:00:12.766132+0000","last_fullsized":"2024-06-11T16:00:12.766132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:35.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":86,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.768481+0000","last_change":"2024-06-11T16:00:06.761223+0000","last_active":"2024-06-11T16:00:12.768481+0000","last_peered":"2024-06-11T16:00:12.768481+0000","last_clean":"2024-06-11T16:00:12.768481+0000","last_became_active":"2024-06-11T16:00:06.733534+0000","last_became_peered":"2024-06-11T16:00:06.733534+0000","last_unstale":"2024-06-11T16:00:12.768481+0000","last_undegraded":"2024-06-11T16:00:12.768481+0000","last_fullsized":"2024-06-11T16:00:12.768481+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:25.557309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.767133+0000","last_change":"2024-06-11T15:59:56.406049+0000","last_active":"2024-06-11T16:00:12.767133+0000","last_peered":"2024-06-11T16:00:12.767133+0000","last_clean":"2024-06-11T15:58:55.147970+0000","last_became_active":"2024-06-11T15:59:56.406049+0000","last_became_peered":"2024-06-11T15:59:56.406049+0000","last_unstale":"2024-06-11T16:00:12.767133+0000","last_undegraded":"2024-06-11T16:00:12.767133+0000","last_fullsized":"2024-06-11T15:59:56.403036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:56.943518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765546+0000","last_change":"2024-06-11T16:00:06.732366+0000","last_active":"2024-06-11T16:00:12.765546+0000","last_peered":"2024-06-11T16:00:12.765546+0000","last_clean":"2024-06-11T16:00:12.765546+0000","last_became_active":"2024-06-11T16:00:06.729985+0000","last_became_peered":"2024-06-11T16:00:06.729985+0000","last_unstale":"2024-06-11T16:00:12.765546+0000","last_undegraded":"2024-06-11T16:00:12.765546+0000","last_fullsized":"2024-06-11T16:00:12.765546+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:26:03.026776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765973+0000","last_change":"2024-06-11T16:00:06.732542+0000","last_active":"2024-06-11T16:00:12.765973+0000","last_peered":"2024-06-11T16:00:12.765973+0000","last_clean":"2024-06-11T16:00:12.765973+0000","last_became_active":"2024-06-11T16:00:06.731255+0000","last_became_peered":"2024-06-11T16:00:06.731255+0000","last_unstale":"2024-06-11T16:00:12.765973+0000","last_undegraded":"2024-06-11T16:00:12.765973+0000","last_fullsized":"2024-06-11T16:00:12.765973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:04:19.929277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"22'10","reported_seq":54,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:12.766489+0000","last_change":"2024-06-11T15:59:56.404029+0000","last_active":"2024-06-11T16:00:12.766489+0000","last_peered":"2024-06-11T16:00:12.766489+0000","last_clean":"2024-06-11T15:59:24.509079+0000","last_became_active":"2024-06-11T15:59:56.404029+0000","last_became_peered":"2024-06-11T15:59:56.404029+0000","last_unstale":"2024-06-11T16:00:12.766489+0000","last_undegraded":"2024-06-11T15:59:56.401205+0000","last_fullsized":"2024-06-11T15:59:56.401119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.685489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765997+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:00:12.765997+0000","last_peered":"2024-06-11T16:00:12.765997+0000","last_clean":"2024-06-11T16:00:12.765997+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:00:12.765997+0000","last_undegraded":"2024-06-11T16:00:12.765997+0000","last_fullsized":"2024-06-11T16:00:12.765997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":66,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:12.766838+0000","last_change":"2024-06-11T15:59:56.407748+0000","last_active":"2024-06-11T16:00:12.766838+0000","last_peered":"2024-06-11T16:00:12.766838+0000","last_clean":"2024-06-11T15:59:45.515376+0000","last_became_active":"2024-06-11T15:59:56.407748+0000","last_became_peered":"2024-06-11T15:59:56.407748+0000","last_unstale":"2024-06-11T16:00:12.766838+0000","last_undegraded":"2024-06-11T15:59:56.405775+0000","last_fullsized":"2024-06-11T15:59:56.405701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:00.944820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767071+0000","last_change":"2024-06-11T16:00:06.729785+0000","last_active":"2024-06-11T16:00:12.767071+0000","last_peered":"2024-06-11T16:00:12.767071+0000","last_clean":"2024-06-11T16:00:12.767071+0000","last_became_active":"2024-06-11T16:00:06.728029+0000","last_became_peered":"2024-06-11T16:00:06.728029+0000","last_unstale":"2024-06-11T16:00:12.767071+0000","last_undegraded":"2024-06-11T16:00:12.767071+0000","last_fullsized":"2024-06-11T16:00:12.767071+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:40.886742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765847+0000","last_change":"2024-06-11T16:00:06.734202+0000","last_active":"2024-06-11T16:00:12.765847+0000","last_peered":"2024-06-11T16:00:12.765847+0000","last_clean":"2024-06-11T16:00:12.765847+0000","last_became_active":"2024-06-11T16:00:06.733217+0000","last_became_peered":"2024-06-11T16:00:06.733217+0000","last_unstale":"2024-06-11T16:00:12.765847+0000","last_undegraded":"2024-06-11T16:00:12.765847+0000","last_fullsized":"2024-06-11T16:00:12.765847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:31.247464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767270+0000","last_change":"2024-06-11T16:00:06.732126+0000","last_active":"2024-06-11T16:00:12.767270+0000","last_peered":"2024-06-11T16:00:12.767270+0000","last_clean":"2024-06-11T16:00:12.767270+0000","last_became_active":"2024-06-11T16:00:06.731826+0000","last_became_peered":"2024-06-11T16:00:06.731826+0000","last_unstale":"2024-06-11T16:00:12.767270+0000","last_undegraded":"2024-06-11T16:00:12.767270+0000","last_fullsized":"2024-06-11T16:00:12.767270+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:40:27.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765990+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:00:12.765990+0000","last_peered":"2024-06-11T16:00:12.765990+0000","last_clean":"2024-06-11T16:00:12.765990+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:00:12.765990+0000","last_undegraded":"2024-06-11T16:00:12.765990+0000","last_fullsized":"2024-06-11T16:00:12.765990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.767020+0000","last_change":"2024-06-11T15:59:56.405793+0000","last_active":"2024-06-11T16:00:12.767020+0000","last_peered":"2024-06-11T16:00:12.767020+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405793+0000","last_became_peered":"2024-06-11T15:59:56.405793+0000","last_unstale":"2024-06-11T16:00:12.767020+0000","last_undegraded":"2024-06-11T16:00:12.767020+0000","last_fullsized":"2024-06-11T15:59:56.402292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:42:36.697100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766294+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:00:12.766294+0000","last_peered":"2024-06-11T16:00:12.766294+0000","last_clean":"2024-06-11T16:00:12.766294+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:00:12.766294+0000","last_undegraded":"2024-06-11T16:00:12.766294+0000","last_fullsized":"2024-06-11T16:00:12.766294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767278+0000","last_change":"2024-06-11T16:00:06.733930+0000","last_active":"2024-06-11T16:00:12.767278+0000","last_peered":"2024-06-11T16:00:12.767278+0000","last_clean":"2024-06-11T16:00:12.767278+0000","last_became_active":"2024-06-11T16:00:06.733386+0000","last_became_peered":"2024-06-11T16:00:06.733386+0000","last_unstale":"2024-06-11T16:00:12.767278+0000","last_undegraded":"2024-06-11T16:00:12.767278+0000","last_fullsized":"2024-06-11T16:00:12.767278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:38:34.805513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766081+0000","last_change":"2024-06-11T16:00:06.735029+0000","last_active":"2024-06-11T16:00:12.766081+0000","last_peered":"2024-06-11T16:00:12.766081+0000","last_clean":"2024-06-11T16:00:12.766081+0000","last_became_active":"2024-06-11T16:00:06.733409+0000","last_became_peered":"2024-06-11T16:00:06.733409+0000","last_unstale":"2024-06-11T16:00:12.766081+0000","last_undegraded":"2024-06-11T16:00:12.766081+0000","last_fullsized":"2024-06-11T16:00:12.766081+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766856+0000","last_change":"2024-06-11T16:00:06.731080+0000","last_active":"2024-06-11T16:00:12.766856+0000","last_peered":"2024-06-11T16:00:12.766856+0000","last_clean":"2024-06-11T16:00:12.766856+0000","last_became_active":"2024-06-11T16:00:06.727597+0000","last_became_peered":"2024-06-11T16:00:06.727597+0000","last_unstale":"2024-06-11T16:00:12.766856+0000","last_undegraded":"2024-06-11T16:00:12.766856+0000","last_fullsized":"2024-06-11T16:00:12.766856+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:52:27.028359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765894+0000","last_change":"2024-06-11T15:59:29.305122+0000","last_active":"2024-06-11T16:00:12.765894+0000","last_peered":"2024-06-11T16:00:12.765894+0000","last_clean":"2024-06-11T16:00:12.765894+0000","last_became_active":"2024-06-11T15:59:29.304793+0000","last_became_peered":"2024-06-11T15:59:29.304793+0000","last_unstale":"2024-06-11T16:00:12.765894+0000","last_undegraded":"2024-06-11T16:00:12.765894+0000","last_fullsized":"2024-06-11T16:00:12.765894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:30:40.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766443+0000","last_change":"2024-06-11T15:59:29.308065+0000","last_active":"2024-06-11T16:00:12.766443+0000","last_peered":"2024-06-11T16:00:12.766443+0000","last_clean":"2024-06-11T16:00:12.766443+0000","last_became_active":"2024-06-11T15:59:29.307541+0000","last_became_peered":"2024-06-11T15:59:29.307541+0000","last_unstale":"2024-06-11T16:00:12.766443+0000","last_undegraded":"2024-06-11T16:00:12.766443+0000","last_fullsized":"2024-06-11T16:00:12.766443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:01:30.960914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765971+0000","last_change":"2024-06-11T16:00:06.733548+0000","last_active":"2024-06-11T16:00:12.765971+0000","last_peered":"2024-06-11T16:00:12.765971+0000","last_clean":"2024-06-11T16:00:12.765971+0000","last_became_active":"2024-06-11T16:00:06.732173+0000","last_became_peered":"2024-06-11T16:00:06.732173+0000","last_unstale":"2024-06-11T16:00:12.765971+0000","last_undegraded":"2024-06-11T16:00:12.765971+0000","last_fullsized":"2024-06-11T16:00:12.765971+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:49.916407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.765828+0000","last_change":"2024-06-11T16:00:06.732865+0000","last_active":"2024-06-11T16:00:12.765828+0000","last_peered":"2024-06-11T16:00:12.765828+0000","last_clean":"2024-06-11T16:00:12.765828+0000","last_became_active":"2024-06-11T16:00:06.731899+0000","last_became_peered":"2024-06-11T16:00:06.731899+0000","last_unstale":"2024-06-11T16:00:12.765828+0000","last_undegraded":"2024-06-11T16:00:12.765828+0000","last_fullsized":"2024-06-11T16:00:12.765828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:26:57.512382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":46,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766834+0000","last_change":"2024-06-11T16:00:06.742695+0000","last_active":"2024-06-11T16:00:12.766834+0000","last_peered":"2024-06-11T16:00:12.766834+0000","last_clean":"2024-06-11T16:00:12.766834+0000","last_became_active":"2024-06-11T16:00:06.729796+0000","last_became_peered":"2024-06-11T16:00:06.729796+0000","last_unstale":"2024-06-11T16:00:12.766834+0000","last_undegraded":"2024-06-11T16:00:12.766834+0000","last_fullsized":"2024-06-11T16:00:12.766834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:42:13.786513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766098+0000","last_change":"2024-06-11T16:00:06.731819+0000","last_active":"2024-06-11T16:00:12.766098+0000","last_peered":"2024-06-11T16:00:12.766098+0000","last_clean":"2024-06-11T16:00:12.766098+0000","last_became_active":"2024-06-11T16:00:06.731150+0000","last_became_peered":"2024-06-11T16:00:06.731150+0000","last_unstale":"2024-06-11T16:00:12.766098+0000","last_undegraded":"2024-06-11T16:00:12.766098+0000","last_fullsized":"2024-06-11T16:00:12.766098+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:55:26.515232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767277+0000","last_change":"2024-06-11T16:00:06.753989+0000","last_active":"2024-06-11T16:00:12.767277+0000","last_peered":"2024-06-11T16:00:12.767277+0000","last_clean":"2024-06-11T16:00:12.767277+0000","last_became_active":"2024-06-11T16:00:06.731991+0000","last_became_peered":"2024-06-11T16:00:06.731991+0000","last_unstale":"2024-06-11T16:00:12.767277+0000","last_undegraded":"2024-06-11T16:00:12.767277+0000","last_fullsized":"2024-06-11T16:00:12.767277+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:35:10.544048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.766167+0000","last_change":"2024-06-11T15:59:29.308075+0000","last_active":"2024-06-11T16:00:12.766167+0000","last_peered":"2024-06-11T16:00:12.766167+0000","last_clean":"2024-06-11T16:00:12.766167+0000","last_became_active":"2024-06-11T15:59:29.307570+0000","last_became_peered":"2024-06-11T15:59:29.307570+0000","last_unstale":"2024-06-11T16:00:12.766167+0000","last_undegraded":"2024-06-11T16:00:12.766167+0000","last_fullsized":"2024-06-11T16:00:12.766167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:41.270065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767384+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:00:12.767384+0000","last_peered":"2024-06-11T16:00:12.767384+0000","last_clean":"2024-06-11T16:00:12.767384+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:00:12.767384+0000","last_undegraded":"2024-06-11T16:00:12.767384+0000","last_fullsized":"2024-06-11T16:00:12.767384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-06-11T16:00:12.765676+0000","last_change":"2024-06-11T15:59:56.402742+0000","last_active":"2024-06-11T16:00:12.765676+0000","last_peered":"2024-06-11T16:00:12.765676+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.402742+0000","last_became_peered":"2024-06-11T15:59:56.402742+0000","last_unstale":"2024-06-11T16:00:12.765676+0000","last_undegraded":"2024-06-11T16:00:12.765676+0000","last_fullsized":"2024-06-11T15:59:56.400903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:17:00.768242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-06-11T16:00:12.767169+0000","last_change":"2024-06-11T16:00:06.745478+0000","last_active":"2024-06-11T16:00:12.767169+0000","last_peered":"2024-06-11T16:00:12.767169+0000","last_clean":"2024-06-11T16:00:12.767169+0000","last_became_active":"2024-06-11T16:00:06.729808+0000","last_became_peered":"2024-06-11T16:00:06.729808+0000","last_unstale":"2024-06-11T16:00:12.767169+0000","last_undegraded":"2024-06-11T16:00:12.767169+0000","last_fullsized":"2024-06-11T16:00:12.767169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:19.971127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":118,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7350,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":652,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":15352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":56,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":722699,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":483328,"data_stored":775054,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":772648,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:00:16.719 INFO:tasks.thrashosds.thrasher:Setting 4.3e to [1, 2, 0] 2024-06-11T16:00:16.719 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.3e', '1', '2', '0'] 2024-06-11T16:00:16.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.3e 1 2 0 2024-06-11T16:00:16.727 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:16.728+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:16.811 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.811 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.819 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:16.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:16.829+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:16.928 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:16.928 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:16.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:16.930+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:16.938 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:17.030 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.031+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.042 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.042 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.051 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:17.053 INFO:teuthology.orchestra.run.smithi089.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-06-11T16:00:17.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-06-11T16:00:17.058 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-06-11T16:00:17.135 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.136+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.196 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.196 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.205 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:17.246 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.247+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.311 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.311 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.320 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:17.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:17.364+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:17.425 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.425 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.434 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:17.434 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.434+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.535 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.535+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.580 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.581 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.591 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:17.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:17.636+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:17.698 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.699 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.708 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:17.752 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:17.753+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:17.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:17.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T16:00:17.812 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:17.812 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:17.821 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:17.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:17.838+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:17.893 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:17.893 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:17.911 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:17.912 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:17.915 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:17.915 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:17.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:17.938+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.968 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771901639000006, 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:17.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771744648999999, 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.974 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:17.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:17.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:17.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771704240000005, 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:17.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:17.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:17.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.985 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771630521000006, 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:17.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771493061000001, 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:17.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:17.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.997 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771459257999993, 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:17.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:18.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:18.003 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771154463000002, 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:18.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.007 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771072201999999, 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:18.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.011 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.771030679999996, 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:18.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.770078773999998, 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.016 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:18.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.770011898000007, 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:18.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:18.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:18.025 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.769696346000003, 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:18.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:18.029 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.769151198000003, 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:18.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:18.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.768811239000001, 2024-06-11T16:00:18.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:18.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.038 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.766294529999996, 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:18.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:18.043 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 76.773140683999998, 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:18.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:18.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:18.049 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.771157957, 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:18.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:18.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:18.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 51.77023896, 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:18.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:18.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.061 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.230699286, 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:18.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:18.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:18.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.220011849, 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:18.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.070 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:18.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:18.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:18.072+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:18.172 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.173+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.176 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:18.177 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:18.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:18.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:18.274+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:18.290 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:18.290 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:18.299 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:18.374 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.374+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.445 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.961827412999995, 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.96126615, 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.959000123999999, 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.958445914999999, 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.951237031999995, 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.950809996999993, 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.492829904999994, 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247377999999998, 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247262731000006, 2024-06-11T16:00:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247230930000001, 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247174165999994, 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247147663999996, 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247118616999998, 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247067559000001, 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.247015926000003, 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.240833839999993, 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.236512332999993, 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.236336519000005, 2024-06-11T16:00:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.236268370000005, 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.236208828000002, 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:18.551 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:18.552 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.552+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.552 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:18.653 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.654+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.664 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:18.665 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:18.665 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:18.665 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:18.674 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:18.758 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.759+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.781 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T16:00:18.821 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:18.821 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:18.821 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:18.821 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:18.821 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:18.831 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:18.872 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.873+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-06-11T16:00:18.955 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:18.956+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:18.977 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.781410096000002, 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.978 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:18.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:18.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.781253105999994, 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:18.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:18.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.989 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.781212697000001, 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:18.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:18.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:18.995 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.781138978000001, 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:18.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:18.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.781001517999997, 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:19.001 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:19.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:19.006 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.780967715000003, 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:19.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.780662919999997, 2024-06-11T16:00:19.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.780580658999995, 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:19.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.780539137000005, 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.021 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:19.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:19.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.779587230999994, 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:19.025 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:19.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:19.029 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.779520355000002, 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.030 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:19.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:19.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.779204802999999, 2024-06-11T16:00:19.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:19.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.778659654999998, 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.038 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:19.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.042 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.778319695999997, 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:19.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 79.775802987000006, 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:19.051 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 77.782649140999993, 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:19.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:19.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:19.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 58.780666414000002, 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:19.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.063 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 52.779747417000003, 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:19.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:19.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.240207742999999, 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.229520306, 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:19.073 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.077 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:19.079 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:19.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.079+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.180 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:19.180+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:19.188 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:19.188 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:19.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:19.281 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:19.282+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:19.299 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:19.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:19.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.382+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.933056331000003, 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.932495067999994, 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.930229041999993, 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.929674833000007, 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.922465950000003, 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.922038915000002, 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.464058823000002, 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218606918000006, 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218491649000001, 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218459847999995, 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218403084000002, 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218376582000005, 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218347535000007, 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218296476999996, 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.218244843999997, 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.212062758000002, 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.207741251000002, 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.207565437, 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.207497287999999, 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.207437745999997, 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:19.515 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:19.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.517+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.517 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:19.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.619+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.625 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:19.625 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:19.625 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:19.625 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:19.633 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:19.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.719+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.738 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:19.738 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:19.738 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:19.738 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:19.738 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:19.747 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:19.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.820+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.853 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.657128295999996, 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.854 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.855 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.856 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:19.857 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.858 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:19.859 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656971306000003, 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.860 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:19.861 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:19.862 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.863 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.864 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:19.865 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656930896999995, 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.866 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.867 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:19.868 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:19.869 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:19.870 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.871 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656857177999996, 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.872 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:19.873 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.874 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.875 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.876 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656719718000005, 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:19.877 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.878 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:19.879 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:19.880 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:19.881 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.882 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656685914999997, 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.883 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:19.884 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:19.885 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:19.886 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.887 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656381120000006, 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.888 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:19.889 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:19.890 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:19.891 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656298859000003, 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.892 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.893 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:19.894 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.895 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.656257337, 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.897 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.898 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:19.899 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.655305431000002, 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:19.900 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.901 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.902 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.903 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.904 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.655238554999997, 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.905 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:19.906 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.907 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.908 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.654923002999993, 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.909 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:19.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:19.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.654377855000007, 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:19.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.654037896000006, 2024-06-11T16:00:19.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:19.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:19.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 80.651521187, 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:19.925 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 78.658367341000002, 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:19.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:19.931 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 59.656384613999997, 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:19.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 53.655465616999997, 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.938 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:19.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.943 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.115925943000001, 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.944 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:19.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:19.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.948 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 13.105238505999999, 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.952 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:19.953 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:19.953 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:19.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:19.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:19.955+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:19.955 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:20.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.056+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.067 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:20.067 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:20.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:20.085 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:20.085 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:20.104 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:20.104 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:20.106 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:20.107 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:20.156 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:20.156+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:20.221 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.221 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:20.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.276+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.336 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.336 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.344 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:20.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.386+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.453 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.453 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.459+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.462 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:20.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.561+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.567 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.567 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:20.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.662+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:20.694 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.694 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.703 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:20.762 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:20.763+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:20.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T16:00:20.811 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.811 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:20.863 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:20.863+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:20.925 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:20.925 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:20.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:20.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:20.980+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:21.040 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.040 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.049 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:21.092 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.093+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.156 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.156 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.165 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:21.205 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.206+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:21.268+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:21.309 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.309 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.318 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:21.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:21.368+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:21.422 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.422 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:21.468 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.469+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.537 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.537 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.546 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:21.569 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.569+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.650 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.650 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:21.669 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.670+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.764 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.764 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:21.771+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:21.774 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:21.788 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T16:00:21.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:21.872+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:21.882 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.882 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:21.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:21.972 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:21.973+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:21.996 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:21.996 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:22.005 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:22.059 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:22.059 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:22.060 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-06-11T16:00:22.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T16:00:22.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.073+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:22.152 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:22.153 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:22.164 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:22.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.208+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.266 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:22.266 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:22.270 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:22.270 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:22.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.275+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.279 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:22.284 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:22.284 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:22.284 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:22.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:22.288 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:22.376 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:22.376+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:22.394 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:00:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 51, 2024-06-11T16:00:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T16:00:22.394 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T16:00:21.785362+0000", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:59:55.393491+0000", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:22.395 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T16:00:22.396 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:22.397 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:22.398 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:22.399 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:22.400 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T16:00:22.401 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "score_type": "Fair distribution", 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 2, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 2, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "optimal_score": 1, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_acting": 2, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "raw_score_stable": 2, 2024-06-11T16:00:22.402 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity": 1, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:22.403 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:22.404 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:22.405 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:22.406 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:22.407 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable", 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:22.408 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:22.409 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:22.410 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:22.411 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:22.413 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable", 2024-06-11T16:00:22.414 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:22.415 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:22.416 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:22.417 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:22.418 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:22.419 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable", 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:22.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:22.421 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 46, 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T16:00:22.422 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.423 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.424 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:22.425 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:22.426 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T16:00:22.427 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T16:00:22.428 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.429 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.430 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:22.431 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0.233062744140625, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 33, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 38, 2024-06-11T16:00:22.432 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.433 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.434 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T16:00:22.435 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:22.436 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.437 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:22.438 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 37 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.439 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T16:00:22.440 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:22.441 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:00:22.443 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:22.443 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:22.443 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:22.443 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:22.443 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:22.444 INFO:tasks.thrashosds.thrasher:j is {'epoch': 51, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T16:00:21.785362+0000', 'last_up_change': '2024-06-11T15:59:55.393491+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.9), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.8), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 0, 'in': 1, 'weight': 0.233062744140625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 38, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T16:00:22.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:00:22.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:22.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.489+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.554 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.071280338999998, 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.070719076000003, 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:22.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:22.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.068453050000002, 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.564 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.568 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.067898841000002, 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:22.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:22.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.060689957999998, 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:22.573 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:22.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.060262922999996, 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:22.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:22.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:22.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.602282830999997, 2024-06-11T16:00:22.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:22.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:22.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356830926000001, 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:22.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:22.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356715656999995, 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:22.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:22.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:22.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356683856000004, 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:22.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:22.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356627091999997, 2024-06-11T16:00:22.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:22.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.611 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356600589999999, 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:22.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:22.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356571543000001, 2024-06-11T16:00:22.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:22.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:22.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356520485000004, 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.623 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:22.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.628 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.356468852000006, 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:22.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:22.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:22.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.350286765999996, 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.633 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:22.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.637 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.345965258999996, 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:22.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.345789444999994, 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:22.642 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:22.646 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.345721295999994, 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:22.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:22.651 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.345661754000005, 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:22.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:22.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:22.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:22.656 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:22.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.658+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.658 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:22.733 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:22.734 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:00:22.744 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-06-11T16:00:21.790150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":607058,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":263,"num_write_kb":3496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":591020,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":191,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94872,"kb_used_data":1328,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020648,"statfs":{"total":289910292480,"available":289813143552,"internally_reserved":0,"allocated":1359872,"data_stored":2292413,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":4784,"internal_metadata":95743312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9340,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.199230"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778475+0000","last_change":"2024-06-11T15:59:29.308333+0000","last_active":"2024-06-11T16:00:15.778475+0000","last_peered":"2024-06-11T16:00:15.778475+0000","last_clean":"2024-06-11T16:00:15.778475+0000","last_became_active":"2024-06-11T15:59:29.307745+0000","last_became_peered":"2024-06-11T15:59:29.307745+0000","last_unstale":"2024-06-11T16:00:15.778475+0000","last_undegraded":"2024-06-11T16:00:15.778475+0000","last_fullsized":"2024-06-11T16:00:15.778475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777548+0000","last_change":"2024-06-11T15:59:47.370239+0000","last_active":"2024-06-11T16:00:15.777548+0000","last_peered":"2024-06-11T16:00:15.777548+0000","last_clean":"2024-06-11T16:00:15.777548+0000","last_became_active":"2024-06-11T15:59:47.370069+0000","last_became_peered":"2024-06-11T15:59:47.370069+0000","last_unstale":"2024-06-11T16:00:15.777548+0000","last_undegraded":"2024-06-11T16:00:15.777548+0000","last_fullsized":"2024-06-11T16:00:15.777548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:09:08.885403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777560+0000","last_change":"2024-06-11T16:00:06.729026+0000","last_active":"2024-06-11T16:00:15.777560+0000","last_peered":"2024-06-11T16:00:15.777560+0000","last_clean":"2024-06-11T16:00:15.777560+0000","last_became_active":"2024-06-11T16:00:06.726323+0000","last_became_peered":"2024-06-11T16:00:06.726323+0000","last_unstale":"2024-06-11T16:00:15.777560+0000","last_undegraded":"2024-06-11T16:00:15.777560+0000","last_fullsized":"2024-06-11T16:00:15.777560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:02.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777498+0000","last_change":"2024-06-11T16:00:06.729277+0000","last_active":"2024-06-11T16:00:15.777498+0000","last_peered":"2024-06-11T16:00:15.777498+0000","last_clean":"2024-06-11T16:00:15.777498+0000","last_became_active":"2024-06-11T16:00:06.726878+0000","last_became_peered":"2024-06-11T16:00:06.726878+0000","last_unstale":"2024-06-11T16:00:15.777498+0000","last_undegraded":"2024-06-11T16:00:15.777498+0000","last_fullsized":"2024-06-11T16:00:15.777498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:08.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777169+0000","last_change":"2024-06-11T15:59:29.308058+0000","last_active":"2024-06-11T16:00:15.777169+0000","last_peered":"2024-06-11T16:00:15.777169+0000","last_clean":"2024-06-11T16:00:15.777169+0000","last_became_active":"2024-06-11T15:59:29.307440+0000","last_became_peered":"2024-06-11T15:59:29.307440+0000","last_unstale":"2024-06-11T16:00:15.777169+0000","last_undegraded":"2024-06-11T16:00:15.777169+0000","last_fullsized":"2024-06-11T16:00:15.777169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:33:54.815101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776910+0000","last_change":"2024-06-11T16:00:06.731814+0000","last_active":"2024-06-11T16:00:15.776910+0000","last_peered":"2024-06-11T16:00:15.776910+0000","last_clean":"2024-06-11T16:00:15.776910+0000","last_became_active":"2024-06-11T16:00:06.730988+0000","last_became_peered":"2024-06-11T16:00:06.730988+0000","last_unstale":"2024-06-11T16:00:15.776910+0000","last_undegraded":"2024-06-11T16:00:15.776910+0000","last_fullsized":"2024-06-11T16:00:15.776910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:29.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776828+0000","last_change":"2024-06-11T16:00:06.732910+0000","last_active":"2024-06-11T16:00:15.776828+0000","last_peered":"2024-06-11T16:00:15.776828+0000","last_clean":"2024-06-11T16:00:15.776828+0000","last_became_active":"2024-06-11T16:00:06.732336+0000","last_became_peered":"2024-06-11T16:00:06.732336+0000","last_unstale":"2024-06-11T16:00:15.776828+0000","last_undegraded":"2024-06-11T16:00:15.776828+0000","last_fullsized":"2024-06-11T16:00:15.776828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:36.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777121+0000","last_change":"2024-06-11T16:00:06.731388+0000","last_active":"2024-06-11T16:00:15.777121+0000","last_peered":"2024-06-11T16:00:15.777121+0000","last_clean":"2024-06-11T16:00:15.777121+0000","last_became_active":"2024-06-11T16:00:06.730852+0000","last_became_peered":"2024-06-11T16:00:06.730852+0000","last_unstale":"2024-06-11T16:00:15.777121+0000","last_undegraded":"2024-06-11T16:00:15.777121+0000","last_fullsized":"2024-06-11T16:00:15.777121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:52:32.141371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777772+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:00:15.777772+0000","last_peered":"2024-06-11T16:00:15.777772+0000","last_clean":"2024-06-11T16:00:15.777772+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:00:15.777772+0000","last_undegraded":"2024-06-11T16:00:15.777772+0000","last_fullsized":"2024-06-11T16:00:15.777772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777459+0000","last_change":"2024-06-11T15:59:47.370396+0000","last_active":"2024-06-11T16:00:15.777459+0000","last_peered":"2024-06-11T16:00:15.777459+0000","last_clean":"2024-06-11T16:00:15.777459+0000","last_became_active":"2024-06-11T15:59:47.370113+0000","last_became_peered":"2024-06-11T15:59:47.370113+0000","last_unstale":"2024-06-11T16:00:15.777459+0000","last_undegraded":"2024-06-11T16:00:15.777459+0000","last_fullsized":"2024-06-11T16:00:15.777459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:05:42.545025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777634+0000","last_change":"2024-06-11T15:59:56.404790+0000","last_active":"2024-06-11T16:00:15.777634+0000","last_peered":"2024-06-11T16:00:15.777634+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404790+0000","last_became_peered":"2024-06-11T15:59:56.404790+0000","last_unstale":"2024-06-11T16:00:15.777634+0000","last_undegraded":"2024-06-11T16:00:15.777634+0000","last_fullsized":"2024-06-11T15:59:56.401805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:59:59.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777028+0000","last_change":"2024-06-11T16:00:06.726442+0000","last_active":"2024-06-11T16:00:15.777028+0000","last_peered":"2024-06-11T16:00:15.777028+0000","last_clean":"2024-06-11T16:00:15.777028+0000","last_became_active":"2024-06-11T16:00:06.725937+0000","last_became_peered":"2024-06-11T16:00:06.725937+0000","last_unstale":"2024-06-11T16:00:15.777028+0000","last_undegraded":"2024-06-11T16:00:15.777028+0000","last_fullsized":"2024-06-11T16:00:15.777028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:25:12.722872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777273+0000","last_change":"2024-06-11T15:59:29.308484+0000","last_active":"2024-06-11T16:00:15.777273+0000","last_peered":"2024-06-11T16:00:15.777273+0000","last_clean":"2024-06-11T16:00:15.777273+0000","last_became_active":"2024-06-11T15:59:29.308104+0000","last_became_peered":"2024-06-11T15:59:29.308104+0000","last_unstale":"2024-06-11T16:00:15.777273+0000","last_undegraded":"2024-06-11T16:00:15.777273+0000","last_fullsized":"2024-06-11T16:00:15.777273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.779666+0000","last_change":"2024-06-11T15:59:56.403777+0000","last_active":"2024-06-11T16:00:15.779666+0000","last_peered":"2024-06-11T16:00:15.779666+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403777+0000","last_became_peered":"2024-06-11T15:59:56.403777+0000","last_unstale":"2024-06-11T16:00:15.779666+0000","last_undegraded":"2024-06-11T16:00:15.779666+0000","last_fullsized":"2024-06-11T15:59:56.400876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776795+0000","last_change":"2024-06-11T16:00:06.731309+0000","last_active":"2024-06-11T16:00:15.776795+0000","last_peered":"2024-06-11T16:00:15.776795+0000","last_clean":"2024-06-11T16:00:15.776795+0000","last_became_active":"2024-06-11T16:00:06.729334+0000","last_became_peered":"2024-06-11T16:00:06.729334+0000","last_unstale":"2024-06-11T16:00:15.776795+0000","last_undegraded":"2024-06-11T16:00:15.776795+0000","last_fullsized":"2024-06-11T16:00:15.776795+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:29.047874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.776898+0000","last_change":"2024-06-11T15:59:56.403626+0000","last_active":"2024-06-11T16:00:15.776898+0000","last_peered":"2024-06-11T16:00:15.776898+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403626+0000","last_became_peered":"2024-06-11T15:59:56.403626+0000","last_unstale":"2024-06-11T16:00:15.776898+0000","last_undegraded":"2024-06-11T16:00:15.776898+0000","last_fullsized":"2024-06-11T15:59:56.401170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:06:39.398270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778578+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:00:15.778578+0000","last_peered":"2024-06-11T16:00:15.778578+0000","last_clean":"2024-06-11T16:00:15.778578+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:00:15.778578+0000","last_undegraded":"2024-06-11T16:00:15.778578+0000","last_fullsized":"2024-06-11T16:00:15.778578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778436+0000","last_change":"2024-06-11T15:59:47.370615+0000","last_active":"2024-06-11T16:00:15.778436+0000","last_peered":"2024-06-11T16:00:15.778436+0000","last_clean":"2024-06-11T16:00:15.778436+0000","last_became_active":"2024-06-11T15:59:47.370447+0000","last_became_peered":"2024-06-11T15:59:47.370447+0000","last_unstale":"2024-06-11T16:00:15.778436+0000","last_undegraded":"2024-06-11T16:00:15.778436+0000","last_fullsized":"2024-06-11T16:00:15.778436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.896374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777944+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:00:15.777944+0000","last_peered":"2024-06-11T16:00:15.777944+0000","last_clean":"2024-06-11T16:00:15.777944+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:00:15.777944+0000","last_undegraded":"2024-06-11T16:00:15.777944+0000","last_fullsized":"2024-06-11T16:00:15.777944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777175+0000","last_change":"2024-06-11T15:59:56.405841+0000","last_active":"2024-06-11T16:00:15.777175+0000","last_peered":"2024-06-11T16:00:15.777175+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405841+0000","last_became_peered":"2024-06-11T15:59:56.405841+0000","last_unstale":"2024-06-11T16:00:15.777175+0000","last_undegraded":"2024-06-11T16:00:15.777175+0000","last_fullsized":"2024-06-11T15:59:56.402278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:11:45.362411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777896+0000","last_change":"2024-06-11T16:00:06.735178+0000","last_active":"2024-06-11T16:00:15.777896+0000","last_peered":"2024-06-11T16:00:15.777896+0000","last_clean":"2024-06-11T16:00:15.777896+0000","last_became_active":"2024-06-11T16:00:06.734286+0000","last_became_peered":"2024-06-11T16:00:06.734286+0000","last_unstale":"2024-06-11T16:00:15.777896+0000","last_undegraded":"2024-06-11T16:00:15.777896+0000","last_fullsized":"2024-06-11T16:00:15.777896+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:17:57.781743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776818+0000","last_change":"2024-06-11T16:00:06.730806+0000","last_active":"2024-06-11T16:00:15.776818+0000","last_peered":"2024-06-11T16:00:15.776818+0000","last_clean":"2024-06-11T16:00:15.776818+0000","last_became_active":"2024-06-11T16:00:06.729901+0000","last_became_peered":"2024-06-11T16:00:06.729901+0000","last_unstale":"2024-06-11T16:00:15.776818+0000","last_undegraded":"2024-06-11T16:00:15.776818+0000","last_fullsized":"2024-06-11T16:00:15.776818+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:29:29.093801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776902+0000","last_change":"2024-06-11T16:00:06.733583+0000","last_active":"2024-06-11T16:00:15.776902+0000","last_peered":"2024-06-11T16:00:15.776902+0000","last_clean":"2024-06-11T16:00:15.776902+0000","last_became_active":"2024-06-11T16:00:06.733040+0000","last_became_peered":"2024-06-11T16:00:06.733040+0000","last_unstale":"2024-06-11T16:00:15.776902+0000","last_undegraded":"2024-06-11T16:00:15.776902+0000","last_fullsized":"2024-06-11T16:00:15.776902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:21.984919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777163+0000","last_change":"2024-06-11T15:59:29.303643+0000","last_active":"2024-06-11T16:00:15.777163+0000","last_peered":"2024-06-11T16:00:15.777163+0000","last_clean":"2024-06-11T16:00:15.777163+0000","last_became_active":"2024-06-11T15:59:29.303337+0000","last_became_peered":"2024-06-11T15:59:29.303337+0000","last_unstale":"2024-06-11T16:00:15.777163+0000","last_undegraded":"2024-06-11T16:00:15.777163+0000","last_fullsized":"2024-06-11T16:00:15.777163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:10:30.771690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777672+0000","last_change":"2024-06-11T16:00:06.726945+0000","last_active":"2024-06-11T16:00:15.777672+0000","last_peered":"2024-06-11T16:00:15.777672+0000","last_clean":"2024-06-11T16:00:15.777672+0000","last_became_active":"2024-06-11T16:00:06.726670+0000","last_became_peered":"2024-06-11T16:00:06.726670+0000","last_unstale":"2024-06-11T16:00:15.777672+0000","last_undegraded":"2024-06-11T16:00:15.777672+0000","last_fullsized":"2024-06-11T16:00:15.777672+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:52:48.804955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777979+0000","last_change":"2024-06-11T16:00:06.730881+0000","last_active":"2024-06-11T16:00:15.777979+0000","last_peered":"2024-06-11T16:00:15.777979+0000","last_clean":"2024-06-11T16:00:15.777979+0000","last_became_active":"2024-06-11T16:00:06.730331+0000","last_became_peered":"2024-06-11T16:00:06.730331+0000","last_unstale":"2024-06-11T16:00:15.777979+0000","last_undegraded":"2024-06-11T16:00:15.777979+0000","last_fullsized":"2024-06-11T16:00:15.777979+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:59.680982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778556+0000","last_change":"2024-06-11T16:00:06.732040+0000","last_active":"2024-06-11T16:00:15.778556+0000","last_peered":"2024-06-11T16:00:15.778556+0000","last_clean":"2024-06-11T16:00:15.778556+0000","last_became_active":"2024-06-11T16:00:06.729809+0000","last_became_peered":"2024-06-11T16:00:06.729809+0000","last_unstale":"2024-06-11T16:00:15.778556+0000","last_undegraded":"2024-06-11T16:00:15.778556+0000","last_fullsized":"2024-06-11T16:00:15.778556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:40:14.285364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.780443+0000","last_change":"2024-06-11T15:59:56.404272+0000","last_active":"2024-06-11T16:00:15.780443+0000","last_peered":"2024-06-11T16:00:15.780443+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404272+0000","last_became_peered":"2024-06-11T15:59:56.404272+0000","last_unstale":"2024-06-11T16:00:15.780443+0000","last_undegraded":"2024-06-11T16:00:15.780443+0000","last_fullsized":"2024-06-11T15:59:56.401760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:28.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777693+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:00:15.777693+0000","last_peered":"2024-06-11T16:00:15.777693+0000","last_clean":"2024-06-11T16:00:15.777693+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:00:15.777693+0000","last_undegraded":"2024-06-11T16:00:15.777693+0000","last_fullsized":"2024-06-11T16:00:15.777693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776997+0000","last_change":"2024-06-11T16:00:06.728137+0000","last_active":"2024-06-11T16:00:15.776997+0000","last_peered":"2024-06-11T16:00:15.776997+0000","last_clean":"2024-06-11T16:00:15.776997+0000","last_became_active":"2024-06-11T16:00:06.727573+0000","last_became_peered":"2024-06-11T16:00:06.727573+0000","last_unstale":"2024-06-11T16:00:15.776997+0000","last_undegraded":"2024-06-11T16:00:15.776997+0000","last_fullsized":"2024-06-11T16:00:15.776997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:33:27.695484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776931+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:00:15.776931+0000","last_peered":"2024-06-11T16:00:15.776931+0000","last_clean":"2024-06-11T16:00:15.776931+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:00:15.776931+0000","last_undegraded":"2024-06-11T16:00:15.776931+0000","last_fullsized":"2024-06-11T16:00:15.776931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776768+0000","last_change":"2024-06-11T16:00:06.731265+0000","last_active":"2024-06-11T16:00:15.776768+0000","last_peered":"2024-06-11T16:00:15.776768+0000","last_clean":"2024-06-11T16:00:15.776768+0000","last_became_active":"2024-06-11T16:00:06.730460+0000","last_became_peered":"2024-06-11T16:00:06.730460+0000","last_unstale":"2024-06-11T16:00:15.776768+0000","last_undegraded":"2024-06-11T16:00:15.776768+0000","last_fullsized":"2024-06-11T16:00:15.776768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:54.914172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777571+0000","last_change":"2024-06-11T15:59:29.307780+0000","last_active":"2024-06-11T16:00:15.777571+0000","last_peered":"2024-06-11T16:00:15.777571+0000","last_clean":"2024-06-11T16:00:15.777571+0000","last_became_active":"2024-06-11T15:59:29.307475+0000","last_became_peered":"2024-06-11T15:59:29.307475+0000","last_unstale":"2024-06-11T16:00:15.777571+0000","last_undegraded":"2024-06-11T16:00:15.777571+0000","last_fullsized":"2024-06-11T16:00:15.777571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:04.032746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":39,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:15.777382+0000","last_change":"2024-06-11T15:59:56.404452+0000","last_active":"2024-06-11T16:00:15.777382+0000","last_peered":"2024-06-11T16:00:15.777382+0000","last_clean":"2024-06-11T15:58:59.196469+0000","last_became_active":"2024-06-11T15:59:56.404452+0000","last_became_peered":"2024-06-11T15:59:56.404452+0000","last_unstale":"2024-06-11T16:00:15.777382+0000","last_undegraded":"2024-06-11T15:59:56.401901+0000","last_fullsized":"2024-06-11T15:59:56.401811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:57:31.951964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777806+0000","last_change":"2024-06-11T15:59:29.308260+0000","last_active":"2024-06-11T16:00:15.777806+0000","last_peered":"2024-06-11T16:00:15.777806+0000","last_clean":"2024-06-11T16:00:15.777806+0000","last_became_active":"2024-06-11T15:59:29.307521+0000","last_became_peered":"2024-06-11T15:59:29.307521+0000","last_unstale":"2024-06-11T16:00:15.777806+0000","last_undegraded":"2024-06-11T16:00:15.777806+0000","last_fullsized":"2024-06-11T16:00:15.777806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:33.415958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777748+0000","last_change":"2024-06-11T15:59:56.404430+0000","last_active":"2024-06-11T16:00:15.777748+0000","last_peered":"2024-06-11T16:00:15.777748+0000","last_clean":"2024-06-11T15:59:54.394866+0000","last_became_active":"2024-06-11T15:59:56.404430+0000","last_became_peered":"2024-06-11T15:59:56.404430+0000","last_unstale":"2024-06-11T16:00:15.777748+0000","last_undegraded":"2024-06-11T16:00:15.777748+0000","last_fullsized":"2024-06-11T15:59:56.401724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:31.755176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.778604+0000","last_change":"2024-06-11T15:59:56.407801+0000","last_active":"2024-06-11T16:00:15.778604+0000","last_peered":"2024-06-11T16:00:15.778604+0000","last_clean":"2024-06-11T15:59:54.395491+0000","last_became_active":"2024-06-11T15:59:56.407801+0000","last_became_peered":"2024-06-11T15:59:56.407801+0000","last_unstale":"2024-06-11T16:00:15.778604+0000","last_undegraded":"2024-06-11T16:00:15.778604+0000","last_fullsized":"2024-06-11T15:59:56.404860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.264606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776716+0000","last_change":"2024-06-11T16:00:06.732106+0000","last_active":"2024-06-11T16:00:15.776716+0000","last_peered":"2024-06-11T16:00:15.776716+0000","last_clean":"2024-06-11T16:00:15.776716+0000","last_became_active":"2024-06-11T16:00:06.729443+0000","last_became_peered":"2024-06-11T16:00:06.729443+0000","last_unstale":"2024-06-11T16:00:15.776716+0000","last_undegraded":"2024-06-11T16:00:15.776716+0000","last_fullsized":"2024-06-11T16:00:15.776716+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T15:59:04.675026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777824+0000","last_change":"2024-06-11T15:59:56.405353+0000","last_active":"2024-06-11T16:00:15.777824+0000","last_peered":"2024-06-11T16:00:15.777824+0000","last_clean":"2024-06-11T15:59:54.395399+0000","last_became_active":"2024-06-11T15:59:56.405353+0000","last_became_peered":"2024-06-11T15:59:56.405353+0000","last_unstale":"2024-06-11T16:00:15.777824+0000","last_undegraded":"2024-06-11T16:00:15.777824+0000","last_fullsized":"2024-06-11T15:59:56.402136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:36.827812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":30,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776653+0000","last_change":"2024-06-11T16:00:06.750390+0000","last_active":"2024-06-11T16:00:15.776653+0000","last_peered":"2024-06-11T16:00:15.776653+0000","last_clean":"2024-06-11T16:00:15.776653+0000","last_became_active":"2024-06-11T16:00:06.730127+0000","last_became_peered":"2024-06-11T16:00:06.730127+0000","last_unstale":"2024-06-11T16:00:15.776653+0000","last_undegraded":"2024-06-11T16:00:15.776653+0000","last_fullsized":"2024-06-11T16:00:15.776653+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:47.680585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":39,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:15.780257+0000","last_change":"2024-06-11T15:59:56.404250+0000","last_active":"2024-06-11T16:00:15.780257+0000","last_peered":"2024-06-11T16:00:15.780257+0000","last_clean":"2024-06-11T15:58:59.195790+0000","last_became_active":"2024-06-11T15:59:56.404250+0000","last_became_peered":"2024-06-11T15:59:56.404250+0000","last_unstale":"2024-06-11T16:00:15.780257+0000","last_undegraded":"2024-06-11T15:59:56.401382+0000","last_fullsized":"2024-06-11T15:59:56.401309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:59:20.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.779593+0000","last_change":"2024-06-11T15:59:56.403389+0000","last_active":"2024-06-11T16:00:15.779593+0000","last_peered":"2024-06-11T16:00:15.779593+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403389+0000","last_became_peered":"2024-06-11T15:59:56.403389+0000","last_unstale":"2024-06-11T16:00:15.779593+0000","last_undegraded":"2024-06-11T16:00:15.779593+0000","last_fullsized":"2024-06-11T15:59:56.400803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777901+0000","last_change":"2024-06-11T16:00:06.759672+0000","last_active":"2024-06-11T16:00:15.777901+0000","last_peered":"2024-06-11T16:00:15.777901+0000","last_clean":"2024-06-11T16:00:15.777901+0000","last_became_active":"2024-06-11T16:00:06.732503+0000","last_became_peered":"2024-06-11T16:00:06.732503+0000","last_unstale":"2024-06-11T16:00:15.777901+0000","last_undegraded":"2024-06-11T16:00:15.777901+0000","last_fullsized":"2024-06-11T16:00:15.777901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777038+0000","last_change":"2024-06-11T15:59:29.305115+0000","last_active":"2024-06-11T16:00:15.777038+0000","last_peered":"2024-06-11T16:00:15.777038+0000","last_clean":"2024-06-11T16:00:15.777038+0000","last_became_active":"2024-06-11T15:59:29.304789+0000","last_became_peered":"2024-06-11T15:59:29.304789+0000","last_unstale":"2024-06-11T16:00:15.777038+0000","last_undegraded":"2024-06-11T16:00:15.777038+0000","last_fullsized":"2024-06-11T16:00:15.777038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:08:21.411683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777336+0000","last_change":"2024-06-11T16:00:06.741350+0000","last_active":"2024-06-11T16:00:15.777336+0000","last_peered":"2024-06-11T16:00:15.777336+0000","last_clean":"2024-06-11T16:00:15.777336+0000","last_became_active":"2024-06-11T16:00:06.726679+0000","last_became_peered":"2024-06-11T16:00:06.726679+0000","last_unstale":"2024-06-11T16:00:15.777336+0000","last_undegraded":"2024-06-11T16:00:15.777336+0000","last_fullsized":"2024-06-11T16:00:15.777336+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:59.285822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778457+0000","last_change":"2024-06-11T16:00:06.734561+0000","last_active":"2024-06-11T16:00:15.778457+0000","last_peered":"2024-06-11T16:00:15.778457+0000","last_clean":"2024-06-11T16:00:15.778457+0000","last_became_active":"2024-06-11T16:00:06.734361+0000","last_became_peered":"2024-06-11T16:00:06.734361+0000","last_unstale":"2024-06-11T16:00:15.778457+0000","last_undegraded":"2024-06-11T16:00:15.778457+0000","last_fullsized":"2024-06-11T16:00:15.778457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:32.369019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777659+0000","last_change":"2024-06-11T16:00:06.731134+0000","last_active":"2024-06-11T16:00:15.777659+0000","last_peered":"2024-06-11T16:00:15.777659+0000","last_clean":"2024-06-11T16:00:15.777659+0000","last_became_active":"2024-06-11T16:00:06.727963+0000","last_became_peered":"2024-06-11T16:00:06.727963+0000","last_unstale":"2024-06-11T16:00:15.777659+0000","last_undegraded":"2024-06-11T16:00:15.777659+0000","last_fullsized":"2024-06-11T16:00:15.777659+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:50.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777794+0000","last_change":"2024-06-11T16:00:06.736430+0000","last_active":"2024-06-11T16:00:15.777794+0000","last_peered":"2024-06-11T16:00:15.777794+0000","last_clean":"2024-06-11T16:00:15.777794+0000","last_became_active":"2024-06-11T16:00:06.736127+0000","last_became_peered":"2024-06-11T16:00:06.736127+0000","last_unstale":"2024-06-11T16:00:15.777794+0000","last_undegraded":"2024-06-11T16:00:15.777794+0000","last_fullsized":"2024-06-11T16:00:15.777794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:53:27.265136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":87,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777967+0000","last_change":"2024-06-11T16:00:06.762561+0000","last_active":"2024-06-11T16:00:15.777967+0000","last_peered":"2024-06-11T16:00:15.777967+0000","last_clean":"2024-06-11T16:00:15.777967+0000","last_became_active":"2024-06-11T16:00:06.735732+0000","last_became_peered":"2024-06-11T16:00:06.735732+0000","last_unstale":"2024-06-11T16:00:15.777967+0000","last_undegraded":"2024-06-11T16:00:15.777967+0000","last_fullsized":"2024-06-11T16:00:15.777967+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:38.902662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777106+0000","last_change":"2024-06-11T16:00:06.729036+0000","last_active":"2024-06-11T16:00:15.777106+0000","last_peered":"2024-06-11T16:00:15.777106+0000","last_clean":"2024-06-11T16:00:15.777106+0000","last_became_active":"2024-06-11T16:00:06.726799+0000","last_became_peered":"2024-06-11T16:00:06.726799+0000","last_unstale":"2024-06-11T16:00:15.777106+0000","last_undegraded":"2024-06-11T16:00:15.777106+0000","last_fullsized":"2024-06-11T16:00:15.777106+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:31.484951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777337+0000","last_change":"2024-06-11T15:59:56.403784+0000","last_active":"2024-06-11T16:00:15.777337+0000","last_peered":"2024-06-11T16:00:15.777337+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403784+0000","last_became_peered":"2024-06-11T15:59:56.403784+0000","last_unstale":"2024-06-11T16:00:15.777337+0000","last_undegraded":"2024-06-11T16:00:15.777337+0000","last_fullsized":"2024-06-11T15:59:56.401221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777192+0000","last_change":"2024-06-11T16:00:06.731326+0000","last_active":"2024-06-11T16:00:15.777192+0000","last_peered":"2024-06-11T16:00:15.777192+0000","last_clean":"2024-06-11T16:00:15.777192+0000","last_became_active":"2024-06-11T16:00:06.730397+0000","last_became_peered":"2024-06-11T16:00:06.730397+0000","last_unstale":"2024-06-11T16:00:15.777192+0000","last_undegraded":"2024-06-11T16:00:15.777192+0000","last_fullsized":"2024-06-11T16:00:15.777192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:36.033362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.779791+0000","last_change":"2024-06-11T15:59:56.405129+0000","last_active":"2024-06-11T16:00:15.779791+0000","last_peered":"2024-06-11T16:00:15.779791+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.405129+0000","last_became_peered":"2024-06-11T15:59:56.405129+0000","last_unstale":"2024-06-11T16:00:15.779791+0000","last_undegraded":"2024-06-11T16:00:15.779791+0000","last_fullsized":"2024-06-11T15:59:56.402039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777401+0000","last_change":"2024-06-11T16:00:06.729783+0000","last_active":"2024-06-11T16:00:15.777401+0000","last_peered":"2024-06-11T16:00:15.777401+0000","last_clean":"2024-06-11T16:00:15.777401+0000","last_became_active":"2024-06-11T16:00:06.728895+0000","last_became_peered":"2024-06-11T16:00:06.728895+0000","last_unstale":"2024-06-11T16:00:15.777401+0000","last_undegraded":"2024-06-11T16:00:15.777401+0000","last_fullsized":"2024-06-11T16:00:15.777401+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:23:47.804555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777225+0000","last_change":"2024-06-11T15:59:47.370077+0000","last_active":"2024-06-11T16:00:15.777225+0000","last_peered":"2024-06-11T16:00:15.777225+0000","last_clean":"2024-06-11T16:00:15.777225+0000","last_became_active":"2024-06-11T15:59:47.369829+0000","last_became_peered":"2024-06-11T15:59:47.369829+0000","last_unstale":"2024-06-11T16:00:15.777225+0000","last_undegraded":"2024-06-11T16:00:15.777225+0000","last_fullsized":"2024-06-11T16:00:15.777225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:39:16.276410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777872+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:00:15.777872+0000","last_peered":"2024-06-11T16:00:15.777872+0000","last_clean":"2024-06-11T16:00:15.777872+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:00:15.777872+0000","last_undegraded":"2024-06-11T16:00:15.777872+0000","last_fullsized":"2024-06-11T16:00:15.777872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777343+0000","last_change":"2024-06-11T16:00:09.739640+0000","last_active":"2024-06-11T16:00:15.777343+0000","last_peered":"2024-06-11T16:00:15.777343+0000","last_clean":"2024-06-11T16:00:15.777343+0000","last_became_active":"2024-06-11T16:00:09.739392+0000","last_became_peered":"2024-06-11T16:00:09.739392+0000","last_unstale":"2024-06-11T16:00:15.777343+0000","last_undegraded":"2024-06-11T16:00:15.777343+0000","last_fullsized":"2024-06-11T16:00:15.777343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:15.633968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777999+0000","last_change":"2024-06-11T16:00:06.736403+0000","last_active":"2024-06-11T16:00:15.777999+0000","last_peered":"2024-06-11T16:00:15.777999+0000","last_clean":"2024-06-11T16:00:15.777999+0000","last_became_active":"2024-06-11T16:00:06.736220+0000","last_became_peered":"2024-06-11T16:00:06.736220+0000","last_unstale":"2024-06-11T16:00:15.777999+0000","last_undegraded":"2024-06-11T16:00:15.777999+0000","last_fullsized":"2024-06-11T16:00:15.777999+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:42.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778551+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:00:15.778551+0000","last_peered":"2024-06-11T16:00:15.778551+0000","last_clean":"2024-06-11T16:00:15.778551+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:00:15.778551+0000","last_undegraded":"2024-06-11T16:00:15.778551+0000","last_fullsized":"2024-06-11T16:00:15.778551+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777473+0000","last_change":"2024-06-11T16:00:06.730859+0000","last_active":"2024-06-11T16:00:15.777473+0000","last_peered":"2024-06-11T16:00:15.777473+0000","last_clean":"2024-06-11T16:00:15.777473+0000","last_became_active":"2024-06-11T16:00:06.727651+0000","last_became_peered":"2024-06-11T16:00:06.727651+0000","last_unstale":"2024-06-11T16:00:15.777473+0000","last_undegraded":"2024-06-11T16:00:15.777473+0000","last_fullsized":"2024-06-11T16:00:15.777473+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:27.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776773+0000","last_change":"2024-06-11T16:00:06.728896+0000","last_active":"2024-06-11T16:00:15.776773+0000","last_peered":"2024-06-11T16:00:15.776773+0000","last_clean":"2024-06-11T16:00:15.776773+0000","last_became_active":"2024-06-11T16:00:06.725941+0000","last_became_peered":"2024-06-11T16:00:06.725941+0000","last_unstale":"2024-06-11T16:00:15.776773+0000","last_undegraded":"2024-06-11T16:00:15.776773+0000","last_fullsized":"2024-06-11T16:00:15.776773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:26.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777333+0000","last_change":"2024-06-11T16:00:06.734401+0000","last_active":"2024-06-11T16:00:15.777333+0000","last_peered":"2024-06-11T16:00:15.777333+0000","last_clean":"2024-06-11T16:00:15.777333+0000","last_became_active":"2024-06-11T16:00:06.733591+0000","last_became_peered":"2024-06-11T16:00:06.733591+0000","last_unstale":"2024-06-11T16:00:15.777333+0000","last_undegraded":"2024-06-11T16:00:15.777333+0000","last_fullsized":"2024-06-11T16:00:15.777333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:53:07.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777651+0000","last_change":"2024-06-11T15:59:29.308305+0000","last_active":"2024-06-11T16:00:15.777651+0000","last_peered":"2024-06-11T16:00:15.777651+0000","last_clean":"2024-06-11T16:00:15.777651+0000","last_became_active":"2024-06-11T15:59:29.307739+0000","last_became_peered":"2024-06-11T15:59:29.307739+0000","last_unstale":"2024-06-11T16:00:15.777651+0000","last_undegraded":"2024-06-11T16:00:15.777651+0000","last_fullsized":"2024-06-11T16:00:15.777651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:37.529774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777479+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:00:15.777479+0000","last_peered":"2024-06-11T16:00:15.777479+0000","last_clean":"2024-06-11T16:00:15.777479+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:00:15.777479+0000","last_undegraded":"2024-06-11T16:00:15.777479+0000","last_fullsized":"2024-06-11T16:00:15.777479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776642+0000","last_change":"2024-06-11T16:00:06.731161+0000","last_active":"2024-06-11T16:00:15.776642+0000","last_peered":"2024-06-11T16:00:15.776642+0000","last_clean":"2024-06-11T16:00:15.776642+0000","last_became_active":"2024-06-11T16:00:06.730198+0000","last_became_peered":"2024-06-11T16:00:06.730198+0000","last_unstale":"2024-06-11T16:00:15.776642+0000","last_undegraded":"2024-06-11T16:00:15.776642+0000","last_fullsized":"2024-06-11T16:00:15.776642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:50:45.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777964+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:00:15.777964+0000","last_peered":"2024-06-11T16:00:15.777964+0000","last_clean":"2024-06-11T16:00:15.777964+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:00:15.777964+0000","last_undegraded":"2024-06-11T16:00:15.777964+0000","last_fullsized":"2024-06-11T16:00:15.777964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778643+0000","last_change":"2024-06-11T16:00:06.733390+0000","last_active":"2024-06-11T16:00:15.778643+0000","last_peered":"2024-06-11T16:00:15.778643+0000","last_clean":"2024-06-11T16:00:15.778643+0000","last_became_active":"2024-06-11T16:00:06.733129+0000","last_became_peered":"2024-06-11T16:00:06.733129+0000","last_unstale":"2024-06-11T16:00:15.778643+0000","last_undegraded":"2024-06-11T16:00:15.778643+0000","last_fullsized":"2024-06-11T16:00:15.778643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:04:02.257999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777586+0000","last_change":"2024-06-11T16:00:06.735376+0000","last_active":"2024-06-11T16:00:15.777586+0000","last_peered":"2024-06-11T16:00:15.777586+0000","last_clean":"2024-06-11T16:00:15.777586+0000","last_became_active":"2024-06-11T16:00:06.734349+0000","last_became_peered":"2024-06-11T16:00:06.734349+0000","last_unstale":"2024-06-11T16:00:15.777586+0000","last_undegraded":"2024-06-11T16:00:15.777586+0000","last_fullsized":"2024-06-11T16:00:15.777586+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:57.761478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777843+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:00:15.777843+0000","last_peered":"2024-06-11T16:00:15.777843+0000","last_clean":"2024-06-11T16:00:15.777843+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:00:15.777843+0000","last_undegraded":"2024-06-11T16:00:15.777843+0000","last_fullsized":"2024-06-11T16:00:15.777843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.777917+0000","last_change":"2024-06-11T15:59:56.403576+0000","last_active":"2024-06-11T16:00:15.777917+0000","last_peered":"2024-06-11T16:00:15.777917+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403576+0000","last_became_peered":"2024-06-11T15:59:56.403576+0000","last_unstale":"2024-06-11T16:00:15.777917+0000","last_undegraded":"2024-06-11T16:00:15.777917+0000","last_fullsized":"2024-06-11T15:59:56.402056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:59:03.781359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778391+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:00:15.778391+0000","last_peered":"2024-06-11T16:00:15.778391+0000","last_clean":"2024-06-11T16:00:15.778391+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:00:15.778391+0000","last_undegraded":"2024-06-11T16:00:15.778391+0000","last_fullsized":"2024-06-11T16:00:15.778391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776818+0000","last_change":"2024-06-11T16:00:06.730456+0000","last_active":"2024-06-11T16:00:15.776818+0000","last_peered":"2024-06-11T16:00:15.776818+0000","last_clean":"2024-06-11T16:00:15.776818+0000","last_became_active":"2024-06-11T16:00:06.729977+0000","last_became_peered":"2024-06-11T16:00:06.729977+0000","last_unstale":"2024-06-11T16:00:15.776818+0000","last_undegraded":"2024-06-11T16:00:15.776818+0000","last_fullsized":"2024-06-11T16:00:15.776818+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:55:24.550321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778352+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:00:15.778352+0000","last_peered":"2024-06-11T16:00:15.778352+0000","last_clean":"2024-06-11T16:00:15.778352+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:00:15.778352+0000","last_undegraded":"2024-06-11T16:00:15.778352+0000","last_fullsized":"2024-06-11T16:00:15.778352+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778645+0000","last_change":"2024-06-11T15:59:29.308481+0000","last_active":"2024-06-11T16:00:15.778645+0000","last_peered":"2024-06-11T16:00:15.778645+0000","last_clean":"2024-06-11T16:00:15.778645+0000","last_became_active":"2024-06-11T15:59:29.307986+0000","last_became_peered":"2024-06-11T15:59:29.307986+0000","last_unstale":"2024-06-11T16:00:15.778645+0000","last_undegraded":"2024-06-11T16:00:15.778645+0000","last_fullsized":"2024-06-11T16:00:15.778645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:20.285064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777017+0000","last_change":"2024-06-11T16:00:06.733056+0000","last_active":"2024-06-11T16:00:15.777017+0000","last_peered":"2024-06-11T16:00:15.777017+0000","last_clean":"2024-06-11T16:00:15.777017+0000","last_became_active":"2024-06-11T16:00:06.732005+0000","last_became_peered":"2024-06-11T16:00:06.732005+0000","last_unstale":"2024-06-11T16:00:15.777017+0000","last_undegraded":"2024-06-11T16:00:15.777017+0000","last_fullsized":"2024-06-11T16:00:15.777017+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:56:26.626148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778574+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:00:15.778574+0000","last_peered":"2024-06-11T16:00:15.778574+0000","last_clean":"2024-06-11T16:00:15.778574+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:00:15.778574+0000","last_undegraded":"2024-06-11T16:00:15.778574+0000","last_fullsized":"2024-06-11T16:00:15.778574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778753+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:00:15.778753+0000","last_peered":"2024-06-11T16:00:15.778753+0000","last_clean":"2024-06-11T16:00:15.778753+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:00:15.778753+0000","last_undegraded":"2024-06-11T16:00:15.778753+0000","last_fullsized":"2024-06-11T16:00:15.778753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777318+0000","last_change":"2024-06-11T16:00:06.733052+0000","last_active":"2024-06-11T16:00:15.777318+0000","last_peered":"2024-06-11T16:00:15.777318+0000","last_clean":"2024-06-11T16:00:15.777318+0000","last_became_active":"2024-06-11T16:00:06.730909+0000","last_became_peered":"2024-06-11T16:00:06.730909+0000","last_unstale":"2024-06-11T16:00:15.777318+0000","last_undegraded":"2024-06-11T16:00:15.777318+0000","last_fullsized":"2024-06-11T16:00:15.777318+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:35.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"49'5","reported_seq":90,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:16.203993+0000","last_change":"2024-06-11T16:00:06.761223+0000","last_active":"2024-06-11T16:00:16.203993+0000","last_peered":"2024-06-11T16:00:16.203993+0000","last_clean":"2024-06-11T16:00:16.203993+0000","last_became_active":"2024-06-11T16:00:06.733534+0000","last_became_peered":"2024-06-11T16:00:06.733534+0000","last_unstale":"2024-06-11T16:00:16.203993+0000","last_undegraded":"2024-06-11T16:00:16.203993+0000","last_fullsized":"2024-06-11T16:00:16.203993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:25.557309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.780877+0000","last_change":"2024-06-11T15:59:56.406049+0000","last_active":"2024-06-11T16:00:15.780877+0000","last_peered":"2024-06-11T16:00:15.780877+0000","last_clean":"2024-06-11T15:58:55.147970+0000","last_became_active":"2024-06-11T15:59:56.406049+0000","last_became_peered":"2024-06-11T15:59:56.406049+0000","last_unstale":"2024-06-11T16:00:15.780877+0000","last_undegraded":"2024-06-11T16:00:15.780877+0000","last_fullsized":"2024-06-11T15:59:56.403036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:56.943518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776731+0000","last_change":"2024-06-11T16:00:06.732366+0000","last_active":"2024-06-11T16:00:15.776731+0000","last_peered":"2024-06-11T16:00:15.776731+0000","last_clean":"2024-06-11T16:00:15.776731+0000","last_became_active":"2024-06-11T16:00:06.729985+0000","last_became_peered":"2024-06-11T16:00:06.729985+0000","last_unstale":"2024-06-11T16:00:15.776731+0000","last_undegraded":"2024-06-11T16:00:15.776731+0000","last_fullsized":"2024-06-11T16:00:15.776731+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:26:03.026776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.776933+0000","last_change":"2024-06-11T16:00:06.732542+0000","last_active":"2024-06-11T16:00:15.776933+0000","last_peered":"2024-06-11T16:00:15.776933+0000","last_clean":"2024-06-11T16:00:15.776933+0000","last_became_active":"2024-06-11T16:00:06.731255+0000","last_became_peered":"2024-06-11T16:00:06.731255+0000","last_unstale":"2024-06-11T16:00:15.776933+0000","last_undegraded":"2024-06-11T16:00:15.776933+0000","last_fullsized":"2024-06-11T16:00:15.776933+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:04:19.929277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"49'12","reported_seq":58,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:16.258298+0000","last_change":"2024-06-11T15:59:56.404029+0000","last_active":"2024-06-11T16:00:16.258298+0000","last_peered":"2024-06-11T16:00:16.258298+0000","last_clean":"2024-06-11T15:59:24.509079+0000","last_became_active":"2024-06-11T15:59:56.404029+0000","last_became_peered":"2024-06-11T15:59:56.404029+0000","last_unstale":"2024-06-11T16:00:16.258298+0000","last_undegraded":"2024-06-11T15:59:56.401205+0000","last_fullsized":"2024-06-11T15:59:56.401119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.685489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15892,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777409+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:00:15.777409+0000","last_peered":"2024-06-11T16:00:15.777409+0000","last_clean":"2024-06-11T16:00:15.777409+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:00:15.777409+0000","last_undegraded":"2024-06-11T16:00:15.777409+0000","last_fullsized":"2024-06-11T16:00:15.777409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":68,"reported_epoch":49,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:15.780241+0000","last_change":"2024-06-11T15:59:56.407748+0000","last_active":"2024-06-11T16:00:15.780241+0000","last_peered":"2024-06-11T16:00:15.780241+0000","last_clean":"2024-06-11T15:59:45.515376+0000","last_became_active":"2024-06-11T15:59:56.407748+0000","last_became_peered":"2024-06-11T15:59:56.407748+0000","last_unstale":"2024-06-11T16:00:15.780241+0000","last_undegraded":"2024-06-11T15:59:56.405775+0000","last_fullsized":"2024-06-11T15:59:56.405701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:00.944820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777728+0000","last_change":"2024-06-11T16:00:06.729785+0000","last_active":"2024-06-11T16:00:15.777728+0000","last_peered":"2024-06-11T16:00:15.777728+0000","last_clean":"2024-06-11T16:00:15.777728+0000","last_became_active":"2024-06-11T16:00:06.728029+0000","last_became_peered":"2024-06-11T16:00:06.728029+0000","last_unstale":"2024-06-11T16:00:15.777728+0000","last_undegraded":"2024-06-11T16:00:15.777728+0000","last_fullsized":"2024-06-11T16:00:15.777728+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:40.886742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777001+0000","last_change":"2024-06-11T16:00:06.734202+0000","last_active":"2024-06-11T16:00:15.777001+0000","last_peered":"2024-06-11T16:00:15.777001+0000","last_clean":"2024-06-11T16:00:15.777001+0000","last_became_active":"2024-06-11T16:00:06.733217+0000","last_became_peered":"2024-06-11T16:00:06.733217+0000","last_unstale":"2024-06-11T16:00:15.777001+0000","last_undegraded":"2024-06-11T16:00:15.777001+0000","last_fullsized":"2024-06-11T16:00:15.777001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:31.247464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778491+0000","last_change":"2024-06-11T16:00:06.732126+0000","last_active":"2024-06-11T16:00:15.778491+0000","last_peered":"2024-06-11T16:00:15.778491+0000","last_clean":"2024-06-11T16:00:15.778491+0000","last_became_active":"2024-06-11T16:00:06.731826+0000","last_became_peered":"2024-06-11T16:00:06.731826+0000","last_unstale":"2024-06-11T16:00:15.778491+0000","last_undegraded":"2024-06-11T16:00:15.778491+0000","last_fullsized":"2024-06-11T16:00:15.778491+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:40:27.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777249+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:00:15.777249+0000","last_peered":"2024-06-11T16:00:15.777249+0000","last_clean":"2024-06-11T16:00:15.777249+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:00:15.777249+0000","last_undegraded":"2024-06-11T16:00:15.777249+0000","last_fullsized":"2024-06-11T16:00:15.777249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.780791+0000","last_change":"2024-06-11T15:59:56.405793+0000","last_active":"2024-06-11T16:00:15.780791+0000","last_peered":"2024-06-11T16:00:15.780791+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405793+0000","last_became_peered":"2024-06-11T15:59:56.405793+0000","last_unstale":"2024-06-11T16:00:15.780791+0000","last_undegraded":"2024-06-11T16:00:15.780791+0000","last_fullsized":"2024-06-11T15:59:56.402292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:42:36.697100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777409+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:00:15.777409+0000","last_peered":"2024-06-11T16:00:15.777409+0000","last_clean":"2024-06-11T16:00:15.777409+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:00:15.777409+0000","last_undegraded":"2024-06-11T16:00:15.777409+0000","last_fullsized":"2024-06-11T16:00:15.777409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778498+0000","last_change":"2024-06-11T16:00:06.733930+0000","last_active":"2024-06-11T16:00:15.778498+0000","last_peered":"2024-06-11T16:00:15.778498+0000","last_clean":"2024-06-11T16:00:15.778498+0000","last_became_active":"2024-06-11T16:00:06.733386+0000","last_became_peered":"2024-06-11T16:00:06.733386+0000","last_unstale":"2024-06-11T16:00:15.778498+0000","last_undegraded":"2024-06-11T16:00:15.778498+0000","last_fullsized":"2024-06-11T16:00:15.778498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:38:34.805513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777240+0000","last_change":"2024-06-11T16:00:06.735029+0000","last_active":"2024-06-11T16:00:15.777240+0000","last_peered":"2024-06-11T16:00:15.777240+0000","last_clean":"2024-06-11T16:00:15.777240+0000","last_became_active":"2024-06-11T16:00:06.733409+0000","last_became_peered":"2024-06-11T16:00:06.733409+0000","last_unstale":"2024-06-11T16:00:15.777240+0000","last_undegraded":"2024-06-11T16:00:15.777240+0000","last_fullsized":"2024-06-11T16:00:15.777240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777271+0000","last_change":"2024-06-11T16:00:06.731080+0000","last_active":"2024-06-11T16:00:15.777271+0000","last_peered":"2024-06-11T16:00:15.777271+0000","last_clean":"2024-06-11T16:00:15.777271+0000","last_became_active":"2024-06-11T16:00:06.727597+0000","last_became_peered":"2024-06-11T16:00:06.727597+0000","last_unstale":"2024-06-11T16:00:15.777271+0000","last_undegraded":"2024-06-11T16:00:15.777271+0000","last_fullsized":"2024-06-11T16:00:15.777271+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:52:27.028359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777112+0000","last_change":"2024-06-11T15:59:29.305122+0000","last_active":"2024-06-11T16:00:15.777112+0000","last_peered":"2024-06-11T16:00:15.777112+0000","last_clean":"2024-06-11T16:00:15.777112+0000","last_became_active":"2024-06-11T15:59:29.304793+0000","last_became_peered":"2024-06-11T15:59:29.304793+0000","last_unstale":"2024-06-11T16:00:15.777112+0000","last_undegraded":"2024-06-11T16:00:15.777112+0000","last_fullsized":"2024-06-11T16:00:15.777112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:30:40.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777561+0000","last_change":"2024-06-11T15:59:29.308065+0000","last_active":"2024-06-11T16:00:15.777561+0000","last_peered":"2024-06-11T16:00:15.777561+0000","last_clean":"2024-06-11T16:00:15.777561+0000","last_became_active":"2024-06-11T15:59:29.307541+0000","last_became_peered":"2024-06-11T15:59:29.307541+0000","last_unstale":"2024-06-11T16:00:15.777561+0000","last_undegraded":"2024-06-11T16:00:15.777561+0000","last_fullsized":"2024-06-11T16:00:15.777561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:01:30.960914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777805+0000","last_change":"2024-06-11T16:00:06.733548+0000","last_active":"2024-06-11T16:00:15.777805+0000","last_peered":"2024-06-11T16:00:15.777805+0000","last_clean":"2024-06-11T16:00:15.777805+0000","last_became_active":"2024-06-11T16:00:06.732173+0000","last_became_peered":"2024-06-11T16:00:06.732173+0000","last_unstale":"2024-06-11T16:00:15.777805+0000","last_undegraded":"2024-06-11T16:00:15.777805+0000","last_fullsized":"2024-06-11T16:00:15.777805+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:49.916407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777052+0000","last_change":"2024-06-11T16:00:06.732865+0000","last_active":"2024-06-11T16:00:15.777052+0000","last_peered":"2024-06-11T16:00:15.777052+0000","last_clean":"2024-06-11T16:00:15.777052+0000","last_became_active":"2024-06-11T16:00:06.731899+0000","last_became_peered":"2024-06-11T16:00:06.731899+0000","last_unstale":"2024-06-11T16:00:15.777052+0000","last_undegraded":"2024-06-11T16:00:15.777052+0000","last_fullsized":"2024-06-11T16:00:15.777052+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:26:57.512382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":48,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777734+0000","last_change":"2024-06-11T16:00:06.742695+0000","last_active":"2024-06-11T16:00:15.777734+0000","last_peered":"2024-06-11T16:00:15.777734+0000","last_clean":"2024-06-11T16:00:15.777734+0000","last_became_active":"2024-06-11T16:00:06.729796+0000","last_became_peered":"2024-06-11T16:00:06.729796+0000","last_unstale":"2024-06-11T16:00:15.777734+0000","last_undegraded":"2024-06-11T16:00:15.777734+0000","last_fullsized":"2024-06-11T16:00:15.777734+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:42:13.786513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777622+0000","last_change":"2024-06-11T16:00:06.731819+0000","last_active":"2024-06-11T16:00:15.777622+0000","last_peered":"2024-06-11T16:00:15.777622+0000","last_clean":"2024-06-11T16:00:15.777622+0000","last_became_active":"2024-06-11T16:00:06.731150+0000","last_became_peered":"2024-06-11T16:00:06.731150+0000","last_unstale":"2024-06-11T16:00:15.777622+0000","last_undegraded":"2024-06-11T16:00:15.777622+0000","last_fullsized":"2024-06-11T16:00:15.777622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:55:26.515232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":24,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777711+0000","last_change":"2024-06-11T16:00:06.753989+0000","last_active":"2024-06-11T16:00:15.777711+0000","last_peered":"2024-06-11T16:00:15.777711+0000","last_clean":"2024-06-11T16:00:15.777711+0000","last_became_active":"2024-06-11T16:00:06.731991+0000","last_became_peered":"2024-06-11T16:00:06.731991+0000","last_unstale":"2024-06-11T16:00:15.777711+0000","last_undegraded":"2024-06-11T16:00:15.777711+0000","last_fullsized":"2024-06-11T16:00:15.777711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:35:10.544048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.777423+0000","last_change":"2024-06-11T15:59:29.308075+0000","last_active":"2024-06-11T16:00:15.777423+0000","last_peered":"2024-06-11T16:00:15.777423+0000","last_clean":"2024-06-11T16:00:15.777423+0000","last_became_active":"2024-06-11T15:59:29.307570+0000","last_became_peered":"2024-06-11T15:59:29.307570+0000","last_unstale":"2024-06-11T16:00:15.777423+0000","last_undegraded":"2024-06-11T16:00:15.777423+0000","last_fullsized":"2024-06-11T16:00:15.777423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:41.270065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778543+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:00:15.778543+0000","last_peered":"2024-06-11T16:00:15.778543+0000","last_clean":"2024-06-11T16:00:15.778543+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:00:15.778543+0000","last_undegraded":"2024-06-11T16:00:15.778543+0000","last_fullsized":"2024-06-11T16:00:15.778543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+undersized","last_fresh":"2024-06-11T16:00:15.776897+0000","last_change":"2024-06-11T15:59:56.402742+0000","last_active":"2024-06-11T16:00:15.776897+0000","last_peered":"2024-06-11T16:00:15.776897+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.402742+0000","last_became_peered":"2024-06-11T15:59:56.402742+0000","last_unstale":"2024-06-11T16:00:15.776897+0000","last_undegraded":"2024-06-11T16:00:15.776897+0000","last_fullsized":"2024-06-11T15:59:56.400903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:17:00.768242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":91,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-06-11T16:00:15.778404+0000","last_change":"2024-06-11T16:00:06.745478+0000","last_active":"2024-06-11T16:00:15.778404+0000","last_peered":"2024-06-11T16:00:15.778404+0000","last_clean":"2024-06-11T16:00:15.778404+0000","last_became_active":"2024-06-11T16:00:06.729808+0000","last_became_peered":"2024-06-11T16:00:06.729808+0000","last_unstale":"2024-06-11T16:00:15.778404+0000","last_undegraded":"2024-06-11T16:00:15.778404+0000","last_fullsized":"2024-06-11T16:00:15.778404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:19.971127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":118,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":16690,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":652,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":24692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":56,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":722699,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738390,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":792842,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738390,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":776872,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":16656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:00:22.748 INFO:tasks.thrashosds.thrasher:Setting 4.2e to [0, 1, 2] 2024-06-11T16:00:22.748 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2e', '0', '1', '2'] 2024-06-11T16:00:22.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2e 0 1 2 2024-06-11T16:00:22.757 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:22.758+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:22.766 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:22.766 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:22.766 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:22.766 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:22.775 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:22.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:22.859+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:22.921 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:22.922 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:22.922 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:22.922 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:22.922 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:22.931 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:22.974 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:22.975+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:23.039 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.842260601999996, 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.040 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:23.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:23.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:23.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:23.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.047 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.842103612000002, 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:23.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:23.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:23.053 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.842063202999995, 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:23.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:23.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841989483999996, 2024-06-11T16:00:23.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:23.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:23.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:23.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841852024000005, 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.065 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:23.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:23.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:23.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841818220999997, 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:23.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:23.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841513426000006, 2024-06-11T16:00:23.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.080 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841431165000003, 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:23.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.841389642999999, 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.840437737000002, 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.089 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.840370860999997, 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:23.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:23.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.840055308999993, 2024-06-11T16:00:23.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:23.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:23.102 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.839510161000007, 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:23.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:23.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:23.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.839170202000005, 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:23.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:23.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:23.111 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 83.836653493, 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 81.843499647000002, 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:23.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.841516919999997, 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:23.121 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:23.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.126 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 56.840597922999997, 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:23.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:23.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:23.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 16.301058249, 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:23.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.136 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 16.290370811999999, 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:23.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:23.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:23.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:23.141 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:23.142 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-06-11T16:00:23.143 INFO:teuthology.orchestra.run.smithi089.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-06-11T16:00:23.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:23.144 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:23.143+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:23.144 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-06-11T16:00:23.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:23.244+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:23.250 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:23.251 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:23.251 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:23.251 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:23.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:23.344 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:23.345+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:23.406 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:23.407 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:23.407 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:23.407 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:23.407 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:23.417 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:23.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:23.462+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.526 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.043055225000003, 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:23.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:23.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:23.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.042493961999995, 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:23.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:23.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.040227935999994, 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:23.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.039673726999993, 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:23.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:23.544 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.032464844000003, 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:23.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:23.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.032037809000002, 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:23.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 90.574057717000002, 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:23.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:23.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328605812000006, 2024-06-11T16:00:23.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:23.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:23.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328490543000001, 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328458741999995, 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.569 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:23.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:23.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:23.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328401978000002, 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:23.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:23.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:23.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328375476000005, 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.580 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:23.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:23.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328346429000007, 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:23.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.591 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328295370999996, 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.596 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.328243737999998, 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:23.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.322061652000002, 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:23.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:23.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.317740145000002, 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:23.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.317564331, 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.609 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:23.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.317496181999999, 2024-06-11T16:00:23.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:23.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:23.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:23.617 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.317436639999997, 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:23.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.621 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:23.622 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:23.622 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:23.623 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:23.624 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:23.623+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:23.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:23.725+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:23.731 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:23.731 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:23.731 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:23.731 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:23.739 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:23.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:00:23.826 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:23.827+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:23.844 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:23.845 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:23.845 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:23.845 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:23.845 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:23.853 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:23.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:23.928+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.802277081, 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:23.999 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:24.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:24.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.004 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.802120091000006, 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:24.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:24.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:24.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:24.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.009 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.802079681999999, 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:24.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.802005962999999, 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.015 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:24.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:24.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:24.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.801868502999994, 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.020 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:24.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:24.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:24.025 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.801834700000001, 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:24.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:24.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.801529904999995, 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:24.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.801447644000007, 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:24.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.801406122000003, 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.800454216000006, 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.045 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:24.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:24.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.049 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.80038734, 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:24.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:24.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.800071787999997, 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.054 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:24.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.799526639999996, 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.058 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:24.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:24.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.799186680999995, 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:24.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:24.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:24.067 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 84.796669972000004, 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:24.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:24.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.071 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 82.803516126000005, 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:24.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:24.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 63.801533399, 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.077 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:24.082 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 57.800614402000001, 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:24.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:24.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:24.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.088 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.261074728000001, 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:24.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 17.250387290999999, 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:24.093 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:24.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:24.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:24.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:24.097 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:24.099 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:24.099 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:24.099+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:24.199 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:24.200+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:24.205 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:24.205 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:24.205 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:24.205 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:24.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:24.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:24.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:24.301+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:24.319 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:24.319 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:24.319 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:24.320 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:24.320 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:24.328 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:24.410 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:24.411 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:24.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:24.413+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:24.431 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:24.431 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:24.432 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:24.434 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:24.435 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:24.475 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:24.475 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:24.484 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:24.528 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:24.529+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:24.594 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:24.594 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:24.604 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:24.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:24.604+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:24.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:24.705+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:24.748 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:24.749 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:24.757 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:24.797 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:00:24.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2024-06-11T16:00:24.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:24.806+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:24.862 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:24.862 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:24.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:24.907 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:24.908+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:24.976 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:24.976 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:24.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:25.007 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.008+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.089 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.089 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.098 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:25.108 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.109+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.203 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.203 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:25.210+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:25.211 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:25.310 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.311+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.318 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.318 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.327 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:25.412 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.413+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.473 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.473 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.481 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:25.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:25.513+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:25.613 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.613+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.625 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.626 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.635 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:25.713 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:25.714+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:25.743 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.743 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.751 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:25.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:25.815+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:25.855 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:25.855 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:25.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:25.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:25.951+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.011 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:26.012 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:26.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.016+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.020 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:26.117 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:26.118+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:26.126 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:26.127 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:26.135 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:26.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.218+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.282 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:26.282 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:26.288 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:26.332 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:26.333+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:26.393 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:26.393 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:26.402 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:26.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:26.443 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:26.444+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:26.508 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:26.508 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:26.517 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:26.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.521+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.569 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:26.569 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:26.587 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:26.588 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:26.588 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:26.591 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:26.591 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:26.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.622+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.623 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:26.624 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:26.624 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:26.624 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:26.624 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:26.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:26.722 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:26.723+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.296054178000006, 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.295492914999997, 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.293226888999996, 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.292672679999995, 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.285463797000006, 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.285036762000004, 2024-06-11T16:00:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.827056670000005, 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581604764999994, 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581489496000003, 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581457694999997, 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581400931000005, 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581374428999993, 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581345381999995, 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581294323999998, 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.581242691, 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.575060605000004, 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.570739098000004, 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.570563284000002, 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.570495135000002, 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.570435592999999, 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:26.875 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:26.876 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:00:26.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.878+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.878 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:26.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:26.978+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:26.985 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:26.985 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:26.985 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:26.985 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:26.994 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:27.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:27.079+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:27.099 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:27.099 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:27.099 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:27.099 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:27.099 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:27.108 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:27.179 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:27.180+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.216 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019702867000007, 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:27.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:27.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:27.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019545876999999, 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.222 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:27.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.224 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.227 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019505468000006, 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:27.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:27.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019431749000006, 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:27.233 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:27.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:27.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.238 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019294289000001, 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:27.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.244 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.019260485999993, 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:27.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:27.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.018955691000002, 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.250 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.254 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.018873429999999, 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.258 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.018831907999996, 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:27.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.017880001999998, 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:27.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:27.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:27.269 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:27.270 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.017813125999993, 2024-06-11T16:00:27.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:27.270 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.270 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.270 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:27.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:27.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:27.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:27.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:27.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:27.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:27.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:27.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:27.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.280 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.017497574000004, 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.281 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.282 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:27.282 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:27.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:27.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:27.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:27.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:27.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:27.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:27.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:27.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:27.289 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.289 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:27.290 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.016952426000003, 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:27.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:27.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:27.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:27.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:27.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:27.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:27.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:27.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:27.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:27.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:27.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:27.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.301 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:27.302 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:27.302 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.016612467000002, 2024-06-11T16:00:27.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:27.302 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.302 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:27.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:27.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:27.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:27.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:27.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:27.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:27.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:27.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:27.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.313 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:27.313 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:27.313 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 88.014095757999996, 2024-06-11T16:00:27.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:27.313 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.314 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.314 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.314 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:27.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:27.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.319 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 86.020941911999998, 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:27.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:27.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:27.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:27.325 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 67.018959185, 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:27.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 61.018040188000001, 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.331 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:27.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.336 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 20.478500514, 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:27.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:27.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 20.467813076999999, 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:27.341 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:27.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:27.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:27.345 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:27.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:27.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:27.347+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:27.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:27.448+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:27.456 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:27.456 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:27.456 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:27.457 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:27.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:27.549 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:27.549+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:27.610 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:27.611 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:27.611 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:27.611 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:27.611 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:27.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:27.650 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:27.651+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.241884725999995, 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.241323463000001, 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.239057437, 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.238503227999999, 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.231294344999995, 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.230867309999994, 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.772887217999994, 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527435312999998, 2024-06-11T16:00:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:27.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:27.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:27.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527320044000007, 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.763 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:27.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527288243000001, 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:27.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:27.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:27.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:27.774 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527231478999994, 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:27.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:27.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:27.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527204976999997, 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:27.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:27.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527175929999999, 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:27.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:27.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527124872000002, 2024-06-11T16:00:27.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:27.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:27.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.527073239000003, 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:27.798 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:27.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.520891152999994, 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:27.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:27.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.807 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.516569645999994, 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:27.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:27.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.812 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.516393832000006, 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:27.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:27.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.516325683000005, 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:27.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.516266141000003, 2024-06-11T16:00:27.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:27.826 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:27.827 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:00:27.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:27.828+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:27.828 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:27.929 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:27.929+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:27.938 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:27.938 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:27.938 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:27.938 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:27.946 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:28.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:28.030+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:28.092 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:28.093 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:28.093 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:28.093 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:28.093 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:28.101 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:28.145 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:28.145 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:28.145 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-06-11T16:00:28.146 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.202558 2024-06-11T16:00:28.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.20255846588445592 2024-06-11T16:00:28.146 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:28.146+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.207 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.010521268000005, 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.208 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:28.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:28.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.213 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.010364277999997, 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:28.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:28.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:28.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.010323869000004, 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:28.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:28.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.224 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.010250150000005, 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:28.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.01011269, 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.230 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.231 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:28.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:28.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.235 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.010078887000006, 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:28.238 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:28.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:28.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.009774092000001, 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.242 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:28.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.244 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.009691830999998, 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.246 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:28.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.009650308999994, 2024-06-11T16:00:28.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.251 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:28.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:28.254 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.008698402999997, 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:28.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.008631527000006, 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:28.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:28.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:28.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.008315975000002, 2024-06-11T16:00:28.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.007770827000002, 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.267 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:28.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:28.271 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.007430868, 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:28.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:28.276 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 89.004914158999995, 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.279 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:28.280 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 87.011760312999996, 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:28.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.285 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 68.009777585999998, 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.286 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:28.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 62.008858588999999, 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:28.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:28.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:28.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.d 44/43 [PushOp(3:b50e409b:::mds_snaptable:head, version: 18'1, data_included: [0~70], data_size: 70, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b50e409b:::mds_snaptable:head@18'1, size: 70, copy_subset: [(0, 70)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 70, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:28.297 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.469318914999999, 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045742899999999997, 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737703+0000", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.31e-07 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737712+0000", 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5380000000000002e-06 2024-06-11T16:00:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737721+0000", 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2930000000000006e-06 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737732+0000", 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0737000000000001e-05 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737788+0000", 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6016e-05 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.737797+0000", 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0850000000000003e-06 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.738161+0000", 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00036362900000000002 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.301 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "MOSDPGPush(3.10 44/43 [PushOp(3:0bd6d154:::602.00000000:head, version: 18'6, data_included: [], data_size: 0, omap_header_size: 274, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(3:0bd6d154:::602.00000000:head@18'6, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 21.458631478000001, 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051183000000000001, 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:28.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748391+0000", 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2599999999999998e-07 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748398+0000", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.126e-06 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748414+0000", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5447e-05 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748425+0000", 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1113e-05 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748489+0000", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4047000000000005e-05 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748501+0000", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.202e-05 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:06.748903+0000", 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040165099999999999 2024-06-11T16:00:28.305 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.306 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:28.306 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:28.306 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:28.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:28.308 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:28.308+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:28.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:28.409+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:28.415 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:28.416 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:28.416 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:28.416 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:28.424 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:28.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:28.509+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:28.569 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:28.569 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:28.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:28.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:28.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:28.619+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:28.710 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:28.711+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:28.714 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:28.715 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.242018418000001, 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:28.725 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:28.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:28.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.241457155000006, 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.239191129000005, 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:28.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:28.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.238636920000005, 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:28.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:28.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.742 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.231428037000001, 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:28.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.231001001999999, 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:28.753 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.77302091, 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:28.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527569005000004, 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:28.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:28.763 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527453735999998, 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:28.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:28.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:28.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527421935000007, 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:28.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:28.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:28.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.774 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527365171, 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:28.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527338669000002, 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:28.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:28.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527309622000004, 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:28.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:28.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527258563999993, 2024-06-11T16:00:28.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:28.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:28.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.527206930999995, 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:28.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.521024844999999, 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.801 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:28.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:28.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.516703337999999, 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:28.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.516527523999997, 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.516459374999997, 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:28.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.516399832999994, 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:28.819 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:28.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:28.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.823 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:28.824 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:28.824 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:28.825 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:28.826 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:28.826 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:28.827 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:28.827 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:28.827 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:28.828 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.2 primary-affinity to 0.202558 (8132742) 2024-06-11T16:00:28.828 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:28.826+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:28.925 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:28.926+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:28.938 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:28.938 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:28.946 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:29.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.027+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:29.093 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.093 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.103 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:29.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.128+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:29.206 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.207 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:29.228 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:29.228+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:29.323 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.323 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.329+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:29.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:29.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.430+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:29.477 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.477 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:29.530 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:29.531+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:29.629 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.630 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.631 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:29.632+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:29.638 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:29.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.732+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:29.748 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.748 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.757 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:29.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T16:00:29.832 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:29.833+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:29.862 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:29.862 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:29.871 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:29.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:29.934+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.017 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.017 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.025 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:30.034 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:30.035+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:30.133 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.133 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.135+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.141 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:30.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.237+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.287 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.287 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:30.337 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:30.337+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:30.437 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:30.438+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:30.440 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.440 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.449 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:30.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.540+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.555 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.555 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.563 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:30.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-06-11T16:00:30.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.641+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.667 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.667 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.676 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:30.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.741+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.780 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.781 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:30.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:30.831 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T16:00:30.841 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:30.842+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:30.896 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:30.896 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:30.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:30.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:30.950+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:30.953 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:30.953 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:30.972 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:30.972 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:30.972 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:30.975 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:30.976 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:31.010 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:31.010 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:31.010 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:31.011 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:31.011 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:31.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:31.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:31.061+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:31.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:31.145+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:31.166 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.682985248999998, 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.682423986000003, 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.680157960000003, 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.679603751000002, 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.672394867999998, 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.671967832999997, 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.213987740999997, 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968535836000001, 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968420566999995, 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968388766000004, 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968332001999997, 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.9683055, 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968276453000001, 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968225395000005, 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.968173762000006, 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.961991675999997, 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.957670168999996, 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.957494354999994, 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.957426205999994, 2024-06-11T16:00:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:31.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.957366664000006, 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:31.265 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:31.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:31.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:31.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.269 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:31.270 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:31.270 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:31.271 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:31.272+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:31.271 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:31.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:31.373+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:31.378 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:31.378 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:31.378 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:31.378 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:31.387 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:31.473 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:31.474+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:31.496 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:31.496 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:31.496 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:31.496 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:31.496 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:31.505 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:31.588 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:31.589+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:31.652 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:31.652 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455979811000006, 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.653 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:31.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455822820999998, 2024-06-11T16:00:31.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:31.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:31.665 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455782412000005, 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:31.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455708693000005, 2024-06-11T16:00:31.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:31.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:31.677 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455571233000001, 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:31.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455537430000007, 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:31.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:31.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455232635000002, 2024-06-11T16:00:31.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:31.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:31.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.693 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455150373999999, 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:31.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.455108851999995, 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046349989999999999, 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197372+0000", 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197373+0000", 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1200000000000003e-07 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197382+0000", 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5889999999999992e-06 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197389+0000", 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3790000000000003e-06 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197397+0000", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1799999999999996e-06 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197486+0000", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8788000000000004e-05 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197815+0000", 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000329112 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202007+0000", 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041923389999999998 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:29 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.454156945999998, 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034160789999999998, 2024-06-11T16:00:31.702 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.67e-07 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198356+0000", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1659999999999998e-05 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198363+0000", 2024-06-11T16:00:31.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4919999999999996e-06 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198379+0000", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5985999999999999e-05 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198614+0000", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000234832 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198642+0000", 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8019999999999999e-05 2024-06-11T16:00:31.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201704+0000", 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030622420000000002 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201740+0000", 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5580000000000002e-05 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.454090070000007, 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00356106, 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198391+0000", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.77e-07 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198396+0000", 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.989e-06 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198425+0000", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9320999999999999e-05 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198441+0000", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5854000000000001e-05 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199120+0000", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00067831100000000002 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199141+0000", 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1195e-05 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201911+0000", 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027701129999999998 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201952+0000", 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0899999999999998e-05 2024-06-11T16:00:31.710 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 3 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.453774518000003, 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003117912, 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198706+0000", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198707+0000", 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8800000000000003e-07 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198714+0000", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6329999999999996e-06 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198729+0000", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5077e-05 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198745+0000", 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5029e-05 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198822+0000", 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7590999999999996e-05 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201824+0000", 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030020939999999999 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:27 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.453229370000003, 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0033505589999999999, 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199251+0000", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199252+0000", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199259+0000", 2024-06-11T16:00:31.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8839999999999997e-06 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199269+0000", 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0062e-05 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199276+0000", 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3100000000000003e-06 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199337+0000", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0574e-05 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199353+0000", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6368e-05 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202568+0000", 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032149219999999998 2024-06-11T16:00:31.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202602+0000", 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3729999999999997e-05 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.452889411000001, 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026602069999999999, 2024-06-11T16:00:31.719 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199591+0000", 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199592+0000", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199600+0000", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4249999999999998e-06 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199607+0000", 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:31.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199614+0000", 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7260000000000002e-06 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199734+0000", 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011992100000000001 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199752+0000", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8159999999999999e-05 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202195+0000", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024423610000000001 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202252+0000", 2024-06-11T16:00:31.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6811999999999997e-05 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 92.450372701999996, 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059960000000000005, 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202108+0000", 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1799999999999999e-07 2024-06-11T16:00:31.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202111+0000", 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8839999999999998e-06 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202117+0000", 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0440000000000001e-06 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202124+0000", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1539999999999996e-06 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202614+0000", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048915099999999995 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202621+0000", 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9270000000000005e-06 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202708+0000", 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6222000000000002e-05 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 90.457218855999997, 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019537719999999999, 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.728 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195262+0000", 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195264+0000", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3199999999999998e-06 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195299+0000", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4524999999999999e-05 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195329+0000", 2024-06-11T16:00:31.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0412999999999998e-05 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195344+0000", 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4946000000000001e-05 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195486+0000", 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014200399999999999 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195639+0000", 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000152659 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.195780+0000", 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000141099 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.196399+0000", 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00061908299999999998 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197153+0000", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000753938 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197186+0000", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2811000000000001e-05 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:01.197216+0000", 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9974000000000001e-05 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.733 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 71.455236128999999, 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018380569999999999, 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197245+0000", 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197246+0000", 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1039999999999999e-06 2024-06-11T16:00:31.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197256+0000", 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0604e-05 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197271+0000", 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5038999999999999e-05 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197311+0000", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9564000000000003e-05 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197368+0000", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6977e-05 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197444+0000", 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5690000000000002e-05 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.197551+0000", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107433 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.198285+0000", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073380500000000003 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199004+0000", 2024-06-11T16:00:31.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00071875699999999999 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199045+0000", 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1832000000000002e-05 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:20.199083+0000", 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7252000000000002e-05 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.739 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e22)", 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 65.454317132, 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001900555, 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198164+0000", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198166+0000", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8920000000000001e-06 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198176+0000", 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0037000000000001e-05 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198195+0000", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8998e-05 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198220+0000", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5111999999999999e-05 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198281+0000", 2024-06-11T16:00:31.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0798000000000003e-05 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198348+0000", 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7748000000000003e-05 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.198444+0000", 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5981000000000001e-05 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199065+0000", 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00062028300000000001 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.199996+0000", 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00093193599999999996 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200034+0000", 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7190000000000001e-05 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:59:26.200064+0000", 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0580000000000002e-05 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:65 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.204437+0000", 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.44804390100000002, 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001653177, 2024-06-11T16:00:31.745 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204437+0000", 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204437+0000", 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204438+0000", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5899999999999995e-07 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204452+0000", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3994e-05 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204464+0000", 2024-06-11T16:00:31.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.182e-05 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204488+0000", 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4119000000000001e-05 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204532+0000", 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3998999999999997e-05 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204593+0000", 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1218999999999998e-05 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.204681+0000", 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8157000000000003e-05 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.205343+0000", 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00066219200000000003 2024-06-11T16:00:31.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.206026+0000", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000682896 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.206062+0000", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5509999999999997e-05 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.206090+0000", 2024-06-11T16:00:31.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8411999999999998e-05 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.180663249, 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:31.751 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:31.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:31.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:31.756 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:31.758 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:31.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:31.758+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:31.858 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:31.859+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:31.864 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:31.864 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:31.864 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:31.864 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:31.872 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:31.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:31.960+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:31.977 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:31.977 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:31.977 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:31.977 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:31.977 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:31.987 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:32.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:32.071+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:32.135 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:32.135 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:32.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:32.135 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:32.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:109 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'71, mlcod=12'64)", 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.652026793999994, 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005765442, 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483230+0000", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6899999999999997e-07 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483261+0000", 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0889000000000002e-05 2024-06-11T16:00:32.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483273+0000", 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1590000000000001e-05 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483278+0000", 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483320+0000", 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2292000000000001e-05 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483338+0000", 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8556e-05 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488960+0000", 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056219499999999997 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488995+0000", 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4585999999999997e-05 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:110 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'72, mlcod=12'64)", 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.651465530999999, 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052413440000000002, 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.140 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483791+0000", 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.51e-07 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483797+0000", 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4129999999999997e-06 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483810+0000", 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2991e-05 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483814+0000", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0489999999999997e-06 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483913+0000", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9406000000000003e-05 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.483931+0000", 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7924e-05 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.488998+0000", 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005066536 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.489032+0000", 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4474000000000002e-05 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:115 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'77, mlcod=12'66)", 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.649199504999999, 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005851424, 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486057+0000", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486058+0000", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3099999999999996e-07 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486111+0000", 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3214000000000002e-05 2024-06-11T16:00:32.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486121+0000", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0628999999999999e-05 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486129+0000", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5599999999999996e-06 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486194+0000", 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5208000000000003e-05 2024-06-11T16:00:32.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486206+0000", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1822e-05 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491866+0000", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056596729999999996 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491908+0000", 2024-06-11T16:00:32.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2487000000000002e-05 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:116 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'78, mlcod=12'66)", 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.648645295999998, 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053280469999999998, 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486611+0000", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486612+0000", 2024-06-11T16:00:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9900000000000001e-07 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486615+0000", 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7689999999999998e-06 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486624+0000", 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1609999999999992e-06 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486629+0000", 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5809999999999998e-06 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486662+0000", 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3056999999999999e-05 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.486674+0000", 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2393e-05 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491910+0000", 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052356720000000002 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.491939+0000", 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8915e-05 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:120 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'82, mlcod=12'78)", 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.641436412999994, 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055711040000000003, 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493820+0000", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493891+0000", 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1050999999999994e-05 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493901+0000", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493908+0000", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1330000000000001e-06 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493947+0000", 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8707000000000001e-05 2024-06-11T16:00:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.493962+0000", 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4494999999999999e-05 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499360+0000", 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053986290000000003 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499391+0000", 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0684e-05 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:121 1.0 e12/10 1:30306672:devicehealth::main.db.0000000000000000:head v 12'83, mlcod=12'78)", 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.641009378000007, 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051734800000000003, 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494247+0000", 2024-06-11T16:00:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494315+0000", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7470000000000003e-05 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494323+0000", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1729999999999995e-06 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494327+0000", 2024-06-11T16:00:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494359+0000", 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1581999999999997e-05 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.494371+0000", 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2261e-05 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499394+0000", 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050226680000000001 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.499420+0000", 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6424e-05 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.4170.0:182 1.0 e12/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 12'132, mlcod=12'128)", 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 99.183029285999993, 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051471939999999999, 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952227+0000", 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952228+0000", 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9999999999999997e-07 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952264+0000", 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6591999999999998e-05 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952274+0000", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9229999999999997e-06 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952279+0000", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4229999999999998e-06 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952315+0000", 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6816000000000001e-05 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.952326+0000", 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0994e-05 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957353+0000", 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050261910000000002 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:52.957374+0000", 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1654999999999998e-05 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937577380999997, 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937462112000006, 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937430311, 2024-06-11T16:00:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937373546999993, 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937347044999996, 2024-06-11T16:00:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937317997999997, 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937266940000001, 2024-06-11T16:00:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.937215307000002, 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:8 3.10 e18/16 3:09401a81:::601.00000000:head v 18'3, mlcod=0'0)", 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.931033221000007, 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052051780000000004, 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204223+0000", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204228+0000", 2024-06-11T16:00:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1819999999999997e-06 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204233+0000", 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204237+0000", 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0709999999999996e-06 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204283+0000", 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6315e-05 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204303+0000", 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9476000000000001e-05 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209404+0000", 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051014609999999998 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209428+0000", 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3944999999999999e-05 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=18'1)", 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.926711714000007, 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056282019999999997, 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208545+0000", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9200000000000001e-07 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208555+0000", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0416e-05 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208595+0000", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9407999999999999e-05 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208602+0000", 2024-06-11T16:00:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3159999999999999e-06 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208650+0000", 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8229999999999997e-05 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208670+0000", 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9819000000000001e-05 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214118+0000", 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005447487 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214173+0000", 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5034000000000002e-05 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=18'1)", 2024-06-11T16:00:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.926535900000005, 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054820989999999998, 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208720+0000", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208721+0000", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.96e-07 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208725+0000", 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6330000000000004e-06 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208733+0000", 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2930000000000003e-06 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208739+0000", 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4699999999999999e-06 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208907+0000", 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000167417 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208924+0000", 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7470999999999999e-05 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214175+0000", 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052512599999999998 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214202+0000", 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7158999999999999e-05 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:12 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'7, mlcod=18'1)", 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.926467751000004, 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0054333760000000002, 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208789+0000", 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208805+0000", 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6291e-05 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208816+0000", 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0284e-05 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208824+0000", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0909999999999993e-06 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209132+0000", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030841799999999997 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209146+0000", 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3439e-05 2024-06-11T16:00:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214205+0000", 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050590840000000002 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214222+0000", 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.719e-05 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:13 3.10 e18/16 3:0d89b25e:::603.00000000:head v 18'8, mlcod=18'1)", 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.926408209000002, 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053907920000000002, 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208848+0000", 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208849+0000", 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208853+0000", 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.335e-06 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208860+0000", 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6460000000000004e-06 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208865+0000", 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.057e-06 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209285+0000", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00042034199999999998 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.209299+0000", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4195999999999999e-05 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214223+0000", 2024-06-11T16:00:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0049238260000000001 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.214239+0000", 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5909e-05 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.233 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:32.235 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:32.235 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:32.235+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:32.335 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:32.336+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:32.339 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:32.339 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:32.339 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:32.339 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:32.348 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:32.436 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:32.437+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:32.511 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:32.511 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:32.511 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:32.511 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:32.511 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:32.522 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:32.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:32.538+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:32.639 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:32.639+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:32.690 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493924311000001, 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:32.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.696 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493767321000007, 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:32.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:32.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.702 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493726912, 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:32.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493653193, 2024-06-11T16:00:32.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:32.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:32.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493515732999995, 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.714 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:32.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:32.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493481930000002, 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493177134999996, 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.725 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 93.493094873999993, 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.729 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:32.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:32.733 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.218607749, 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:32.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:32.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:32.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.50667179799999995, 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.739 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:32.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:32.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.745 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.50147394000000001, 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:32.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:32.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:32 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~1337428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.48843608900000002, 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082427049999999995, 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32 2024-06-11T16:00:32.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201991+0000", 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9250000000000002e-06 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203544+0000", 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001552903 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203555+0000", 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1316e-05 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203568+0000", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2955e-05 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203621+0000", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2667999999999998e-05 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203719+0000", 2024-06-11T16:00:32.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8268000000000002e-05 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203806+0000", 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206690+0000", 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028845720000000002 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210148+0000", 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034572639999999998 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210191+0000", 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3559000000000001e-05 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210232+0000", 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0674999999999999e-05 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.757 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:80 3.17 3:eaf075c4:::500.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.454317784, 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060625180000000002, 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7000000000000001e-07 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236109+0000", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5239999999999999e-06 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236114+0000", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.006e-06 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236117+0000", 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0869999999999998e-06 2024-06-11T16:00:32.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236166+0000", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8355e-05 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236264+0000", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7866000000000001e-05 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242170+0000", 2024-06-11T16:00:32.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00590641 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:82 3.6 3:66eb7180:::500.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.45430045699999999, 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060403790000000002, 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.762 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.53e-07 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236127+0000", 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1710000000000001e-06 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236133+0000", 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9100000000000002e-06 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236138+0000", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8940000000000001e-06 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236178+0000", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9357000000000003e-05 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236282+0000", 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010432799999999999 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242165+0000", 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058833660000000001 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:83 3.1d 3:bb63c54e:::500.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.45428005300000002, 2024-06-11T16:00:32.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060198439999999999, 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.767 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236146+0000", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7300000000000001e-07 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236148+0000", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.872e-06 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236153+0000", 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8200000000000002e-06 2024-06-11T16:00:32.768 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236158+0000", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8539999999999996e-06 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236206+0000", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7422000000000001e-05 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236272+0000", 2024-06-11T16:00:32.769 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6777000000000001e-05 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242165+0000", 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058926259999999998 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:84 3.b 3:d5442d2d:::500.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:32.770 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.45425456199999997, 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060574729999999999, 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:32.771 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1199999999999998e-07 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236173+0000", 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3290000000000001e-06 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.772 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236180+0000", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0399999999999998e-06 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236186+0000", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1619999999999996e-06 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236226+0000", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9854000000000002e-05 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.773 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236316+0000", 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0808000000000002e-05 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242228+0000", 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059118679999999998 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:39 4.1a 4:582f7b2d:::10000000226.00000000:head [write 0~32] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.774 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.322595888, 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056282809999999997, 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 39 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:32.775 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367830+0000", 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000004e-07 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.776 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367834+0000", 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1250000000000003e-06 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367848+0000", 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3737000000000001e-05 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367854+0000", 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1449999999999996e-06 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.777 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367925+0000", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0356000000000002e-05 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368024+0000", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9259000000000006e-05 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368141+0000", 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117178 2024-06-11T16:00:32.778 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368833+0000", 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00069172199999999997 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373386+0000", 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045532120000000001 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.779 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373421+0000", 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4918e-05 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373458+0000", 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6859000000000001e-05 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.780 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:51 4.13 4:c8893608:::1000000023c.00000000:head [write 0~20657] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.27812777, 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057502159999999998, 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 51 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.781 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:32.782 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5700000000000001e-07 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412319+0000", 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0965e-05 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412329+0000", 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6730000000000004e-06 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.783 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412334+0000", 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2299999999999999e-06 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412371+0000", 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6297999999999997e-05 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412448+0000", 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7390000000000003e-05 2024-06-11T16:00:32.784 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412532+0000", 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4474999999999993e-05 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.413264+0000", 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073109 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.785 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.417963+0000", 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046991380000000003 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.418011+0000", 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7939999999999998e-05 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.418048+0000", 2024-06-11T16:00:32.786 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7160000000000003e-05 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:56 4.13 4:c933d8fa:::10000000241.00000000:head [write 0~910] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.27552900200000002, 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057045259999999997, 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.787 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 56 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.788 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414897+0000", 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9400000000000004e-07 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414904+0000", 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5150000000000003e-06 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.789 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414912+0000", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7460000000000006e-06 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414917+0000", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4410000000000003e-06 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414954+0000", 2024-06-11T16:00:32.790 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6699000000000002e-05 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415046+0000", 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2520000000000002e-05 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415111+0000", 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5109000000000003e-05 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.791 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415709+0000", 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059769700000000001 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420530+0000", 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048209739999999996 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420573+0000", 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3021e-05 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.792 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420601+0000", 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8010000000000001e-05 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:57 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.27504598299999999, 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052770380000000004, 2024-06-11T16:00:32.793 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 57 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:32.794 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415380+0000", 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5899999999999996e-07 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.795 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415383+0000", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1829999999999998e-06 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415390+0000", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4239999999999998e-06 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415394+0000", 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3989999999999997e-06 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.796 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415430+0000", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5911999999999998e-05 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415497+0000", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7488000000000002e-05 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415565+0000", 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7799000000000006e-05 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.797 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.416137+0000", 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00057144100000000001 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420552+0000", 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0044154149999999998 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:32.798 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420618+0000", 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6118000000000006e-05 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420656+0000", 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.82e-05 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:32.799 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:32.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:32.803+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:32.803 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:32.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T16:00:32.904 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:32.905+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:32.918 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:32.918 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:32.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:702 4.26 e55/43 4:675204a5:::100000004d9.00000000:head v 55'11, mlcod=55'9)", 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.919613+0000", 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00042924199999999998, 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00045110700000000002, 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919613+0000", 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919613+0000", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919614+0000", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1099999999999995e-07 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919619+0000", 2024-06-11T16:00:32.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919630+0000", 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1558e-05 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919638+0000", 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4619999999999999e-06 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:32.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919677+0000", 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9121e-05 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.919690+0000", 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3416e-05 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.920057+0000", 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036649600000000001 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.922 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:32.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:32.923 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-06-11T16:00:32.923 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 1 2024-06-11T16:00:32.923 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:32.928 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:32.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:33.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:33.005+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:33.042 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:33.043 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:33.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:33.105 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:33.106+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:33.116 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:33.117 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:33.137 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:33.138 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:33.138 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:33.141 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:33.142 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:33.204 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.204 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:33.207+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:33.214 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:33.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:33.308+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:33.336 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.336 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.347 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:33.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:33.408+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:33.465 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.465 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.475 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:33.519 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:33.520+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:33.589 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.589 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:33.639 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:33.640+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:33.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:33.711+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:33.713 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.713 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.725 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:33.810 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:33.811+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:33.828 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:33.828 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:33.829 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-06-11T16:00:33.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T16:00:33.835 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T16:00:33.880 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:33.880 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:33.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:33.911 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:33.912+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.009 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.009 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.012 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.013+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.020 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:34.113 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.114+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.138 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.138 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.148 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 56, 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T16:00:33.829998+0000", 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:59:55.393491+0000", 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T16:00:34.152 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5806080, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "nodeep-scrub", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "noscrub", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T16:00:34.153 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:34.154 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:34.155 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:34.156 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:34.157 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:34.158 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.159 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:34.160 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:34.161 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:34.162 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:34.163 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:34.164 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T16:00:34.165 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T16:00:34.166 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:34.167 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:34.168 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:34.169 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.170 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T16:00:34.171 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T16:00:34.172 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:34.173 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:34.174 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.175 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.176 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T16:00:34.177 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 46, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:34.178 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.179 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.180 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.181 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.182 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:34.183 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.184 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.185 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.186 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.187 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.188 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0.233062744140625, 2024-06-11T16:00:34.189 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.202545166015625, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 33, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 38, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T16:00:34.190 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T16:00:34.191 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.192 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.193 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:34.194 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:34.195 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:34.196 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 37 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T16:00:34.197 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T16:00:34.198 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:34.199 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:00:34.200 INFO:tasks.thrashosds.thrasher:j is {'epoch': 56, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T16:00:33.829998+0000', 'last_up_change': '2024-06-11T15:59:55.393491+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 0, 'in': 1, 'weight': 0.233062744140625, 'primary_affinity': 0.202545166015625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 38, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T16:00:34.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:00:34.244 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.245+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:34.315+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:34.318 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.318 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.329 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:34.415 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.416+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.487 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.487 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:34.539 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.540+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.576 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:34.577 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:00:34.587 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-06-11T16:00:33.834218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18328520,"num_objects":928,"num_object_clones":0,"num_object_copies":1856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":161,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":928,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":1219,"num_write_kb":21379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":591020,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1169,"ondisk_log_size":1169,"up":191,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":121632,"kb_used_data":28096,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":282993888,"statfs":{"total":289910292480,"available":289785741312,"internally_reserved":0,"allocated":28770304,"data_stored":29681762,"data_compressed":1371853,"data_compressed_allocated":1626112,"data_compressed_original":4780032,"omap_allocated":4784,"internal_metadata":95743312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17712249,"num_objects":904,"num_object_clones":0,"num_object_copies":1808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":904,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":951,"num_write_kb":17872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.021597"},"pg_stats":[{"pgid":"4.3f","version":"55'11","reported_seq":82,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.060427+0000","last_change":"2024-06-11T15:59:29.308333+0000","last_active":"2024-06-11T16:00:33.060427+0000","last_peered":"2024-06-11T16:00:33.060427+0000","last_clean":"2024-06-11T16:00:33.060427+0000","last_became_active":"2024-06-11T15:59:29.307745+0000","last_became_peered":"2024-06-11T15:59:29.307745+0000","last_unstale":"2024-06-11T16:00:33.060427+0000","last_undegraded":"2024-06-11T16:00:33.060427+0000","last_fullsized":"2024-06-11T16:00:33.060427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"55'9","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.097947+0000","last_change":"2024-06-11T15:59:47.370239+0000","last_active":"2024-06-11T16:00:33.097947+0000","last_peered":"2024-06-11T16:00:33.097947+0000","last_clean":"2024-06-11T16:00:33.097947+0000","last_became_active":"2024-06-11T15:59:47.370069+0000","last_became_peered":"2024-06-11T15:59:47.370069+0000","last_unstale":"2024-06-11T16:00:33.097947+0000","last_undegraded":"2024-06-11T16:00:33.097947+0000","last_fullsized":"2024-06-11T16:00:33.097947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:09:08.885403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27068,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"55'19","reported_seq":51,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.094648+0000","last_change":"2024-06-11T16:00:06.729026+0000","last_active":"2024-06-11T16:00:33.094648+0000","last_peered":"2024-06-11T16:00:33.094648+0000","last_clean":"2024-06-11T16:00:33.094648+0000","last_became_active":"2024-06-11T16:00:06.726323+0000","last_became_peered":"2024-06-11T16:00:06.726323+0000","last_unstale":"2024-06-11T16:00:33.094648+0000","last_undegraded":"2024-06-11T16:00:33.094648+0000","last_fullsized":"2024-06-11T16:00:33.094648+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:02.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41212,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'8","reported_seq":53,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.008743+0000","last_change":"2024-06-11T16:00:06.729277+0000","last_active":"2024-06-11T16:00:33.008743+0000","last_peered":"2024-06-11T16:00:33.008743+0000","last_clean":"2024-06-11T16:00:33.008743+0000","last_became_active":"2024-06-11T16:00:06.726878+0000","last_became_peered":"2024-06-11T16:00:06.726878+0000","last_unstale":"2024-06-11T16:00:33.008743+0000","last_undegraded":"2024-06-11T16:00:33.008743+0000","last_fullsized":"2024-06-11T16:00:33.008743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:08.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18161,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'17","reported_seq":88,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.054835+0000","last_change":"2024-06-11T15:59:29.308058+0000","last_active":"2024-06-11T16:00:33.054835+0000","last_peered":"2024-06-11T16:00:33.054835+0000","last_clean":"2024-06-11T16:00:33.054835+0000","last_became_active":"2024-06-11T15:59:29.307440+0000","last_became_peered":"2024-06-11T15:59:29.307440+0000","last_unstale":"2024-06-11T16:00:33.054835+0000","last_undegraded":"2024-06-11T16:00:33.054835+0000","last_fullsized":"2024-06-11T16:00:33.054835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:33:54.815101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34236,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"55'12","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.026211+0000","last_change":"2024-06-11T16:00:06.731814+0000","last_active":"2024-06-11T16:00:33.026211+0000","last_peered":"2024-06-11T16:00:33.026211+0000","last_clean":"2024-06-11T16:00:33.026211+0000","last_became_active":"2024-06-11T16:00:06.730988+0000","last_became_peered":"2024-06-11T16:00:06.730988+0000","last_unstale":"2024-06-11T16:00:33.026211+0000","last_undegraded":"2024-06-11T16:00:33.026211+0000","last_fullsized":"2024-06-11T16:00:33.026211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:29.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84658,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'9","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.017513+0000","last_change":"2024-06-11T16:00:06.732910+0000","last_active":"2024-06-11T16:00:33.017513+0000","last_peered":"2024-06-11T16:00:33.017513+0000","last_clean":"2024-06-11T16:00:33.017513+0000","last_became_active":"2024-06-11T16:00:06.732336+0000","last_became_peered":"2024-06-11T16:00:06.732336+0000","last_unstale":"2024-06-11T16:00:33.017513+0000","last_undegraded":"2024-06-11T16:00:33.017513+0000","last_fullsized":"2024-06-11T16:00:33.017513+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:36.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12452,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'7","reported_seq":52,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.962163+0000","last_change":"2024-06-11T16:00:06.731388+0000","last_active":"2024-06-11T16:00:32.962163+0000","last_peered":"2024-06-11T16:00:32.962163+0000","last_clean":"2024-06-11T16:00:32.962163+0000","last_became_active":"2024-06-11T16:00:06.730852+0000","last_became_peered":"2024-06-11T16:00:06.730852+0000","last_unstale":"2024-06-11T16:00:32.962163+0000","last_undegraded":"2024-06-11T16:00:32.962163+0000","last_fullsized":"2024-06-11T16:00:32.962163+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:52:32.141371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15245,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'17","reported_seq":101,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.027050+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:00:33.027050+0000","last_peered":"2024-06-11T16:00:33.027050+0000","last_clean":"2024-06-11T16:00:33.027050+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:00:33.027050+0000","last_undegraded":"2024-06-11T16:00:33.027050+0000","last_fullsized":"2024-06-11T16:00:33.027050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30051,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"55'14","reported_seq":67,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.815016+0000","last_change":"2024-06-11T15:59:47.370396+0000","last_active":"2024-06-11T16:00:32.815016+0000","last_peered":"2024-06-11T16:00:32.815016+0000","last_clean":"2024-06-11T16:00:32.815016+0000","last_became_active":"2024-06-11T15:59:47.370113+0000","last_became_peered":"2024-06-11T15:59:47.370113+0000","last_unstale":"2024-06-11T16:00:32.815016+0000","last_undegraded":"2024-06-11T16:00:32.815016+0000","last_fullsized":"2024-06-11T16:00:32.815016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:05:42.545025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51748,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"55'14","reported_seq":54,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:33.029839+0000","last_change":"2024-06-11T16:00:32.539261+0000","last_active":"2024-06-11T16:00:33.029839+0000","last_peered":"2024-06-11T16:00:33.029839+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404790+0000","last_became_peered":"2024-06-11T15:59:56.404790+0000","last_unstale":"2024-06-11T16:00:33.029839+0000","last_undegraded":"2024-06-11T16:00:32.480556+0000","last_fullsized":"2024-06-11T15:59:56.401805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:59:59.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26663,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":14}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'11","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.905572+0000","last_change":"2024-06-11T16:00:06.726442+0000","last_active":"2024-06-11T16:00:32.905572+0000","last_peered":"2024-06-11T16:00:32.905572+0000","last_clean":"2024-06-11T16:00:32.905572+0000","last_became_active":"2024-06-11T16:00:06.725937+0000","last_became_peered":"2024-06-11T16:00:06.725937+0000","last_unstale":"2024-06-11T16:00:32.905572+0000","last_undegraded":"2024-06-11T16:00:32.905572+0000","last_fullsized":"2024-06-11T16:00:32.905572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:25:12.722872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32015,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"55'19","reported_seq":90,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.088213+0000","last_change":"2024-06-11T15:59:29.308484+0000","last_active":"2024-06-11T16:00:33.088213+0000","last_peered":"2024-06-11T16:00:33.088213+0000","last_clean":"2024-06-11T16:00:33.088213+0000","last_became_active":"2024-06-11T15:59:29.308104+0000","last_became_peered":"2024-06-11T15:59:29.308104+0000","last_unstale":"2024-06-11T16:00:33.088213+0000","last_undegraded":"2024-06-11T16:00:33.088213+0000","last_fullsized":"2024-06-11T16:00:33.088213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133944,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"55'19","reported_seq":59,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:33.023138+0000","last_change":"2024-06-11T16:00:32.516457+0000","last_active":"2024-06-11T16:00:33.023138+0000","last_peered":"2024-06-11T16:00:33.023138+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403777+0000","last_became_peered":"2024-06-11T15:59:56.403777+0000","last_unstale":"2024-06-11T16:00:33.023138+0000","last_undegraded":"2024-06-11T16:00:32.427033+0000","last_fullsized":"2024-06-11T15:59:56.400876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33457,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":19}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"55'18","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.045274+0000","last_change":"2024-06-11T16:00:06.731309+0000","last_active":"2024-06-11T16:00:33.045274+0000","last_peered":"2024-06-11T16:00:33.045274+0000","last_clean":"2024-06-11T16:00:33.045274+0000","last_became_active":"2024-06-11T16:00:06.729334+0000","last_became_peered":"2024-06-11T16:00:06.729334+0000","last_unstale":"2024-06-11T16:00:33.045274+0000","last_undegraded":"2024-06-11T16:00:33.045274+0000","last_fullsized":"2024-06-11T16:00:33.045274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:29.047874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4301175,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'15","reported_seq":55,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:33.037793+0000","last_change":"2024-06-11T16:00:32.425877+0000","last_active":"2024-06-11T16:00:33.037793+0000","last_peered":"2024-06-11T16:00:33.037793+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403626+0000","last_became_peered":"2024-06-11T15:59:56.403626+0000","last_unstale":"2024-06-11T16:00:33.037793+0000","last_undegraded":"2024-06-11T16:00:31.489307+0000","last_fullsized":"2024-06-11T15:59:56.401170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:06:39.398270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239107,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'17","reported_seq":101,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.075358+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:00:33.075358+0000","last_peered":"2024-06-11T16:00:33.075358+0000","last_clean":"2024-06-11T16:00:33.075358+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:00:33.075358+0000","last_undegraded":"2024-06-11T16:00:33.075358+0000","last_fullsized":"2024-06-11T16:00:33.075358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32025,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"55'21","reported_seq":74,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.895849+0000","last_change":"2024-06-11T15:59:47.370615+0000","last_active":"2024-06-11T16:00:32.895849+0000","last_peered":"2024-06-11T16:00:32.895849+0000","last_clean":"2024-06-11T16:00:32.895849+0000","last_became_active":"2024-06-11T15:59:47.370447+0000","last_became_peered":"2024-06-11T15:59:47.370447+0000","last_unstale":"2024-06-11T16:00:32.895849+0000","last_undegraded":"2024-06-11T16:00:32.895849+0000","last_fullsized":"2024-06-11T16:00:32.895849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.896374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1383770,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"55'17","reported_seq":101,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.016595+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:00:33.016595+0000","last_peered":"2024-06-11T16:00:33.016595+0000","last_clean":"2024-06-11T16:00:33.016595+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:00:33.016595+0000","last_undegraded":"2024-06-11T16:00:33.016595+0000","last_fullsized":"2024-06-11T16:00:33.016595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52810,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"55'15","reported_seq":55,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:33.072032+0000","last_change":"2024-06-11T16:00:30.833258+0000","last_active":"2024-06-11T16:00:33.072032+0000","last_peered":"2024-06-11T16:00:33.072032+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405841+0000","last_became_peered":"2024-06-11T15:59:56.405841+0000","last_unstale":"2024-06-11T16:00:33.072032+0000","last_undegraded":"2024-06-11T16:00:29.735324+0000","last_fullsized":"2024-06-11T15:59:56.402278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:11:45.362411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'21","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.073777+0000","last_change":"2024-06-11T16:00:06.735178+0000","last_active":"2024-06-11T16:00:33.073777+0000","last_peered":"2024-06-11T16:00:33.073777+0000","last_clean":"2024-06-11T16:00:33.073777+0000","last_became_active":"2024-06-11T16:00:06.734286+0000","last_became_peered":"2024-06-11T16:00:06.734286+0000","last_unstale":"2024-06-11T16:00:33.073777+0000","last_undegraded":"2024-06-11T16:00:33.073777+0000","last_fullsized":"2024-06-11T16:00:33.073777+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:17:57.781743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81931,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'15","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.942110+0000","last_change":"2024-06-11T16:00:06.730806+0000","last_active":"2024-06-11T16:00:32.942110+0000","last_peered":"2024-06-11T16:00:32.942110+0000","last_clean":"2024-06-11T16:00:32.942110+0000","last_became_active":"2024-06-11T16:00:06.729901+0000","last_became_peered":"2024-06-11T16:00:06.729901+0000","last_unstale":"2024-06-11T16:00:32.942110+0000","last_undegraded":"2024-06-11T16:00:32.942110+0000","last_fullsized":"2024-06-11T16:00:32.942110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:29:29.093801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38384,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"55'21","reported_seq":112,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.086812+0000","last_change":"2024-06-11T16:00:06.733583+0000","last_active":"2024-06-11T16:00:33.086812+0000","last_peered":"2024-06-11T16:00:33.086812+0000","last_clean":"2024-06-11T16:00:33.086812+0000","last_became_active":"2024-06-11T16:00:06.733040+0000","last_became_peered":"2024-06-11T16:00:06.733040+0000","last_unstale":"2024-06-11T16:00:33.086812+0000","last_undegraded":"2024-06-11T16:00:33.086812+0000","last_fullsized":"2024-06-11T16:00:33.086812+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:21.984919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42482,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"55'14","reported_seq":85,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.982814+0000","last_change":"2024-06-11T15:59:29.303643+0000","last_active":"2024-06-11T16:00:32.982814+0000","last_peered":"2024-06-11T16:00:32.982814+0000","last_clean":"2024-06-11T16:00:32.982814+0000","last_became_active":"2024-06-11T15:59:29.303337+0000","last_became_peered":"2024-06-11T15:59:29.303337+0000","last_unstale":"2024-06-11T16:00:32.982814+0000","last_undegraded":"2024-06-11T16:00:32.982814+0000","last_fullsized":"2024-06-11T16:00:32.982814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:10:30.771690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33817,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"55'16","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.900710+0000","last_change":"2024-06-11T16:00:06.726945+0000","last_active":"2024-06-11T16:00:32.900710+0000","last_peered":"2024-06-11T16:00:32.900710+0000","last_clean":"2024-06-11T16:00:32.900710+0000","last_became_active":"2024-06-11T16:00:06.726670+0000","last_became_peered":"2024-06-11T16:00:06.726670+0000","last_unstale":"2024-06-11T16:00:32.900710+0000","last_undegraded":"2024-06-11T16:00:32.900710+0000","last_fullsized":"2024-06-11T16:00:32.900710+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:52:48.804955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19258,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"55'17","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.101851+0000","last_change":"2024-06-11T16:00:06.730881+0000","last_active":"2024-06-11T16:00:33.101851+0000","last_peered":"2024-06-11T16:00:33.101851+0000","last_clean":"2024-06-11T16:00:33.101851+0000","last_became_active":"2024-06-11T16:00:06.730331+0000","last_became_peered":"2024-06-11T16:00:06.730331+0000","last_unstale":"2024-06-11T16:00:33.101851+0000","last_undegraded":"2024-06-11T16:00:33.101851+0000","last_fullsized":"2024-06-11T16:00:33.101851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:59.680982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302847,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"55'11","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.975136+0000","last_change":"2024-06-11T16:00:06.732040+0000","last_active":"2024-06-11T16:00:32.975136+0000","last_peered":"2024-06-11T16:00:32.975136+0000","last_clean":"2024-06-11T16:00:32.975136+0000","last_became_active":"2024-06-11T16:00:06.729809+0000","last_became_peered":"2024-06-11T16:00:06.729809+0000","last_unstale":"2024-06-11T16:00:32.975136+0000","last_undegraded":"2024-06-11T16:00:32.975136+0000","last_fullsized":"2024-06-11T16:00:32.975136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:40:14.285364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22655,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'12","reported_seq":87,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.954531+0000","last_change":"2024-06-11T16:00:32.397707+0000","last_active":"2024-06-11T16:00:32.954531+0000","last_peered":"2024-06-11T16:00:32.954531+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404272+0000","last_became_peered":"2024-06-11T15:59:56.404272+0000","last_unstale":"2024-06-11T16:00:32.954531+0000","last_undegraded":"2024-06-11T16:00:32.387824+0000","last_fullsized":"2024-06-11T15:59:56.401760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:28.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23054,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":12,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":12}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"55'13","reported_seq":97,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.024196+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:00:33.024196+0000","last_peered":"2024-06-11T16:00:33.024196+0000","last_clean":"2024-06-11T16:00:33.024196+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:00:33.024196+0000","last_undegraded":"2024-06-11T16:00:33.024196+0000","last_fullsized":"2024-06-11T16:00:33.024196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26351,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"55'18","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.000342+0000","last_change":"2024-06-11T16:00:06.728137+0000","last_active":"2024-06-11T16:00:33.000342+0000","last_peered":"2024-06-11T16:00:33.000342+0000","last_clean":"2024-06-11T16:00:33.000342+0000","last_became_active":"2024-06-11T16:00:06.727573+0000","last_became_peered":"2024-06-11T16:00:06.727573+0000","last_unstale":"2024-06-11T16:00:33.000342+0000","last_undegraded":"2024-06-11T16:00:33.000342+0000","last_fullsized":"2024-06-11T16:00:33.000342+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:33:27.695484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64368,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"55'15","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.034937+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:00:33.034937+0000","last_peered":"2024-06-11T16:00:33.034937+0000","last_clean":"2024-06-11T16:00:33.034937+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:00:33.034937+0000","last_undegraded":"2024-06-11T16:00:33.034937+0000","last_fullsized":"2024-06-11T16:00:33.034937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59918,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"55'19","reported_seq":64,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.048097+0000","last_change":"2024-06-11T16:00:06.731265+0000","last_active":"2024-06-11T16:00:33.048097+0000","last_peered":"2024-06-11T16:00:33.048097+0000","last_clean":"2024-06-11T16:00:33.048097+0000","last_became_active":"2024-06-11T16:00:06.730460+0000","last_became_peered":"2024-06-11T16:00:06.730460+0000","last_unstale":"2024-06-11T16:00:33.048097+0000","last_undegraded":"2024-06-11T16:00:33.048097+0000","last_fullsized":"2024-06-11T16:00:33.048097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:54.914172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59595,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'15","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.047186+0000","last_change":"2024-06-11T15:59:29.307780+0000","last_active":"2024-06-11T16:00:33.047186+0000","last_peered":"2024-06-11T16:00:33.047186+0000","last_clean":"2024-06-11T16:00:33.047186+0000","last_became_active":"2024-06-11T15:59:29.307475+0000","last_became_peered":"2024-06-11T15:59:29.307475+0000","last_unstale":"2024-06-11T16:00:33.047186+0000","last_undegraded":"2024-06-11T16:00:33.047186+0000","last_fullsized":"2024-06-11T16:00:33.047186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:04.032746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93568,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":51,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:30.834192+0000","last_change":"2024-06-11T15:59:56.404452+0000","last_active":"2024-06-11T16:00:30.834192+0000","last_peered":"2024-06-11T16:00:30.834192+0000","last_clean":"2024-06-11T15:58:59.196469+0000","last_became_active":"2024-06-11T15:59:56.404452+0000","last_became_peered":"2024-06-11T15:59:56.404452+0000","last_unstale":"2024-06-11T16:00:30.834192+0000","last_undegraded":"2024-06-11T15:59:56.401901+0000","last_fullsized":"2024-06-11T15:59:56.401811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:57:31.951964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'12","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.994323+0000","last_change":"2024-06-11T15:59:29.308260+0000","last_active":"2024-06-11T16:00:32.994323+0000","last_peered":"2024-06-11T16:00:32.994323+0000","last_clean":"2024-06-11T16:00:32.994323+0000","last_became_active":"2024-06-11T15:59:29.307521+0000","last_became_peered":"2024-06-11T15:59:29.307521+0000","last_unstale":"2024-06-11T16:00:32.994323+0000","last_undegraded":"2024-06-11T16:00:32.994323+0000","last_fullsized":"2024-06-11T16:00:32.994323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:33.415958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20720,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-06-11T16:00:30.833620+0000","last_change":"2024-06-11T15:59:56.404430+0000","last_active":"2024-06-11T16:00:30.833620+0000","last_peered":"2024-06-11T16:00:30.833620+0000","last_clean":"2024-06-11T15:59:54.394866+0000","last_became_active":"2024-06-11T15:59:56.404430+0000","last_became_peered":"2024-06-11T15:59:56.404430+0000","last_unstale":"2024-06-11T16:00:30.833620+0000","last_undegraded":"2024-06-11T16:00:30.833620+0000","last_fullsized":"2024-06-11T15:59:56.401724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:31.755176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"55'15","reported_seq":101,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.967639+0000","last_change":"2024-06-11T16:00:32.493364+0000","last_active":"2024-06-11T16:00:32.967639+0000","last_peered":"2024-06-11T16:00:32.967639+0000","last_clean":"2024-06-11T15:59:54.395491+0000","last_became_active":"2024-06-11T15:59:56.407801+0000","last_became_peered":"2024-06-11T15:59:56.407801+0000","last_unstale":"2024-06-11T16:00:32.967639+0000","last_undegraded":"2024-06-11T16:00:32.468476+0000","last_fullsized":"2024-06-11T15:59:56.404860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.264606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46011,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":15}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.832852+0000","last_change":"2024-06-11T16:00:06.732106+0000","last_active":"2024-06-11T16:00:30.832852+0000","last_peered":"2024-06-11T16:00:30.832852+0000","last_clean":"2024-06-11T16:00:30.832852+0000","last_became_active":"2024-06-11T16:00:06.729443+0000","last_became_peered":"2024-06-11T16:00:06.729443+0000","last_unstale":"2024-06-11T16:00:30.832852+0000","last_undegraded":"2024-06-11T16:00:30.832852+0000","last_fullsized":"2024-06-11T16:00:30.832852+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T15:59:04.675026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"55'17","reported_seq":103,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:33.004947+0000","last_change":"2024-06-11T16:00:32.487444+0000","last_active":"2024-06-11T16:00:33.004947+0000","last_peered":"2024-06-11T16:00:33.004947+0000","last_clean":"2024-06-11T15:59:54.395399+0000","last_became_active":"2024-06-11T15:59:56.405353+0000","last_became_peered":"2024-06-11T15:59:56.405353+0000","last_unstale":"2024-06-11T16:00:33.004947+0000","last_undegraded":"2024-06-11T16:00:32.427641+0000","last_fullsized":"2024-06-11T15:59:56.402136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:36.827812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146780,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":17}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.832773+0000","last_change":"2024-06-11T16:00:06.750390+0000","last_active":"2024-06-11T16:00:30.832773+0000","last_peered":"2024-06-11T16:00:30.832773+0000","last_clean":"2024-06-11T16:00:30.832773+0000","last_became_active":"2024-06-11T16:00:06.730127+0000","last_became_peered":"2024-06-11T16:00:06.730127+0000","last_unstale":"2024-06-11T16:00:30.832773+0000","last_undegraded":"2024-06-11T16:00:30.832773+0000","last_fullsized":"2024-06-11T16:00:30.832773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:47.680585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":51,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:30.833572+0000","last_change":"2024-06-11T15:59:56.404250+0000","last_active":"2024-06-11T16:00:30.833572+0000","last_peered":"2024-06-11T16:00:30.833572+0000","last_clean":"2024-06-11T15:58:59.195790+0000","last_became_active":"2024-06-11T15:59:56.404250+0000","last_became_peered":"2024-06-11T15:59:56.404250+0000","last_unstale":"2024-06-11T16:00:30.833572+0000","last_undegraded":"2024-06-11T15:59:56.401382+0000","last_fullsized":"2024-06-11T15:59:56.401309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:59:20.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"55'11","reported_seq":69,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.929754+0000","last_change":"2024-06-11T16:00:32.619682+0000","last_active":"2024-06-11T16:00:32.929754+0000","last_peered":"2024-06-11T16:00:32.929754+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403389+0000","last_became_peered":"2024-06-11T15:59:56.403389+0000","last_unstale":"2024-06-11T16:00:32.929754+0000","last_undegraded":"2024-06-11T16:00:32.504618+0000","last_fullsized":"2024-06-11T15:59:56.400803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59419,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":11,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":11}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834134+0000","last_change":"2024-06-11T16:00:06.759672+0000","last_active":"2024-06-11T16:00:30.834134+0000","last_peered":"2024-06-11T16:00:30.834134+0000","last_clean":"2024-06-11T16:00:30.834134+0000","last_became_active":"2024-06-11T16:00:06.732503+0000","last_became_peered":"2024-06-11T16:00:06.732503+0000","last_unstale":"2024-06-11T16:00:30.834134+0000","last_undegraded":"2024-06-11T16:00:30.834134+0000","last_fullsized":"2024-06-11T16:00:30.834134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"55'8","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.991303+0000","last_change":"2024-06-11T15:59:29.305115+0000","last_active":"2024-06-11T16:00:32.991303+0000","last_peered":"2024-06-11T16:00:32.991303+0000","last_clean":"2024-06-11T16:00:32.991303+0000","last_became_active":"2024-06-11T15:59:29.304789+0000","last_became_peered":"2024-06-11T15:59:29.304789+0000","last_unstale":"2024-06-11T16:00:32.991303+0000","last_undegraded":"2024-06-11T16:00:32.991303+0000","last_fullsized":"2024-06-11T16:00:32.991303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:08:21.411683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121883,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833615+0000","last_change":"2024-06-11T16:00:06.741350+0000","last_active":"2024-06-11T16:00:30.833615+0000","last_peered":"2024-06-11T16:00:30.833615+0000","last_clean":"2024-06-11T16:00:30.833615+0000","last_became_active":"2024-06-11T16:00:06.726679+0000","last_became_peered":"2024-06-11T16:00:06.726679+0000","last_unstale":"2024-06-11T16:00:30.833615+0000","last_undegraded":"2024-06-11T16:00:30.833615+0000","last_fullsized":"2024-06-11T16:00:30.833615+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:59.285822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'12","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.006136+0000","last_change":"2024-06-11T16:00:06.734561+0000","last_active":"2024-06-11T16:00:33.006136+0000","last_peered":"2024-06-11T16:00:33.006136+0000","last_clean":"2024-06-11T16:00:33.006136+0000","last_became_active":"2024-06-11T16:00:06.734361+0000","last_became_peered":"2024-06-11T16:00:06.734361+0000","last_unstale":"2024-06-11T16:00:33.006136+0000","last_undegraded":"2024-06-11T16:00:33.006136+0000","last_fullsized":"2024-06-11T16:00:33.006136+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:32.369019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26752,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833550+0000","last_change":"2024-06-11T16:00:06.731134+0000","last_active":"2024-06-11T16:00:30.833550+0000","last_peered":"2024-06-11T16:00:30.833550+0000","last_clean":"2024-06-11T16:00:30.833550+0000","last_became_active":"2024-06-11T16:00:06.727963+0000","last_became_peered":"2024-06-11T16:00:06.727963+0000","last_unstale":"2024-06-11T16:00:30.833550+0000","last_undegraded":"2024-06-11T16:00:30.833550+0000","last_fullsized":"2024-06-11T16:00:30.833550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:50.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'13","reported_seq":104,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.064849+0000","last_change":"2024-06-11T16:00:06.736430+0000","last_active":"2024-06-11T16:00:33.064849+0000","last_peered":"2024-06-11T16:00:33.064849+0000","last_clean":"2024-06-11T16:00:33.064849+0000","last_became_active":"2024-06-11T16:00:06.736127+0000","last_became_peered":"2024-06-11T16:00:06.736127+0000","last_unstale":"2024-06-11T16:00:33.064849+0000","last_undegraded":"2024-06-11T16:00:33.064849+0000","last_fullsized":"2024-06-11T16:00:33.064849+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:53:27.265136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31908,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"55'3","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834548+0000","last_change":"2024-06-11T16:00:06.762561+0000","last_active":"2024-06-11T16:00:30.834548+0000","last_peered":"2024-06-11T16:00:30.834548+0000","last_clean":"2024-06-11T16:00:30.834548+0000","last_became_active":"2024-06-11T16:00:06.735732+0000","last_became_peered":"2024-06-11T16:00:06.735732+0000","last_unstale":"2024-06-11T16:00:30.834548+0000","last_undegraded":"2024-06-11T16:00:30.834548+0000","last_fullsized":"2024-06-11T16:00:30.834548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:38.902662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"55'14","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.996083+0000","last_change":"2024-06-11T16:00:06.729036+0000","last_active":"2024-06-11T16:00:32.996083+0000","last_peered":"2024-06-11T16:00:32.996083+0000","last_clean":"2024-06-11T16:00:32.996083+0000","last_became_active":"2024-06-11T16:00:06.726799+0000","last_became_peered":"2024-06-11T16:00:06.726799+0000","last_unstale":"2024-06-11T16:00:32.996083+0000","last_undegraded":"2024-06-11T16:00:32.996083+0000","last_fullsized":"2024-06-11T16:00:32.996083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:31.484951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109924,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-06-11T16:00:30.833194+0000","last_change":"2024-06-11T15:59:56.403784+0000","last_active":"2024-06-11T16:00:30.833194+0000","last_peered":"2024-06-11T16:00:30.833194+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403784+0000","last_became_peered":"2024-06-11T15:59:56.403784+0000","last_unstale":"2024-06-11T16:00:30.833194+0000","last_undegraded":"2024-06-11T16:00:30.833194+0000","last_fullsized":"2024-06-11T15:59:56.401221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'14","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.998560+0000","last_change":"2024-06-11T16:00:06.731326+0000","last_active":"2024-06-11T16:00:32.998560+0000","last_peered":"2024-06-11T16:00:32.998560+0000","last_clean":"2024-06-11T16:00:32.998560+0000","last_became_active":"2024-06-11T16:00:06.730397+0000","last_became_peered":"2024-06-11T16:00:06.730397+0000","last_unstale":"2024-06-11T16:00:32.998560+0000","last_undegraded":"2024-06-11T16:00:32.998560+0000","last_fullsized":"2024-06-11T16:00:32.998560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:36.033362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169646,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-06-11T16:00:30.832955+0000","last_change":"2024-06-11T15:59:56.405129+0000","last_active":"2024-06-11T16:00:30.832955+0000","last_peered":"2024-06-11T16:00:30.832955+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.405129+0000","last_became_peered":"2024-06-11T15:59:56.405129+0000","last_unstale":"2024-06-11T16:00:30.832955+0000","last_undegraded":"2024-06-11T16:00:30.832955+0000","last_fullsized":"2024-06-11T15:59:56.402039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"55'9","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.820661+0000","last_change":"2024-06-11T16:00:06.729783+0000","last_active":"2024-06-11T16:00:32.820661+0000","last_peered":"2024-06-11T16:00:32.820661+0000","last_clean":"2024-06-11T16:00:32.820661+0000","last_became_active":"2024-06-11T16:00:06.728895+0000","last_became_peered":"2024-06-11T16:00:06.728895+0000","last_unstale":"2024-06-11T16:00:32.820661+0000","last_undegraded":"2024-06-11T16:00:32.820661+0000","last_fullsized":"2024-06-11T16:00:32.820661+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:23:47.804555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13864,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833267+0000","last_change":"2024-06-11T15:59:47.370077+0000","last_active":"2024-06-11T16:00:30.833267+0000","last_peered":"2024-06-11T16:00:30.833267+0000","last_clean":"2024-06-11T16:00:30.833267+0000","last_became_active":"2024-06-11T15:59:47.369829+0000","last_became_peered":"2024-06-11T15:59:47.369829+0000","last_unstale":"2024-06-11T16:00:30.833267+0000","last_undegraded":"2024-06-11T16:00:30.833267+0000","last_fullsized":"2024-06-11T16:00:30.833267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:39:16.276410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"55'14","reported_seq":98,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.992174+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:00:32.992174+0000","last_peered":"2024-06-11T16:00:32.992174+0000","last_clean":"2024-06-11T16:00:32.992174+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:00:32.992174+0000","last_undegraded":"2024-06-11T16:00:32.992174+0000","last_fullsized":"2024-06-11T16:00:32.992174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73588,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":247,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833672+0000","last_change":"2024-06-11T16:00:09.739640+0000","last_active":"2024-06-11T16:00:30.833672+0000","last_peered":"2024-06-11T16:00:30.833672+0000","last_clean":"2024-06-11T16:00:30.833672+0000","last_became_active":"2024-06-11T16:00:09.739392+0000","last_became_peered":"2024-06-11T16:00:09.739392+0000","last_unstale":"2024-06-11T16:00:30.833672+0000","last_undegraded":"2024-06-11T16:00:30.833672+0000","last_fullsized":"2024-06-11T16:00:30.833672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:15.633968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834607+0000","last_change":"2024-06-11T16:00:06.736403+0000","last_active":"2024-06-11T16:00:30.834607+0000","last_peered":"2024-06-11T16:00:30.834607+0000","last_clean":"2024-06-11T16:00:30.834607+0000","last_became_active":"2024-06-11T16:00:06.736220+0000","last_became_peered":"2024-06-11T16:00:06.736220+0000","last_unstale":"2024-06-11T16:00:30.834607+0000","last_undegraded":"2024-06-11T16:00:30.834607+0000","last_fullsized":"2024-06-11T16:00:30.834607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:42.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834003+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:00:30.834003+0000","last_peered":"2024-06-11T16:00:30.834003+0000","last_clean":"2024-06-11T16:00:30.834003+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:00:30.834003+0000","last_undegraded":"2024-06-11T16:00:30.834003+0000","last_fullsized":"2024-06-11T16:00:30.834003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"55'16","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.972528+0000","last_change":"2024-06-11T16:00:06.730859+0000","last_active":"2024-06-11T16:00:32.972528+0000","last_peered":"2024-06-11T16:00:32.972528+0000","last_clean":"2024-06-11T16:00:32.972528+0000","last_became_active":"2024-06-11T16:00:06.727651+0000","last_became_peered":"2024-06-11T16:00:06.727651+0000","last_unstale":"2024-06-11T16:00:32.972528+0000","last_undegraded":"2024-06-11T16:00:32.972528+0000","last_fullsized":"2024-06-11T16:00:32.972528+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:27.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90335,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.832853+0000","last_change":"2024-06-11T16:00:06.728896+0000","last_active":"2024-06-11T16:00:30.832853+0000","last_peered":"2024-06-11T16:00:30.832853+0000","last_clean":"2024-06-11T16:00:30.832853+0000","last_became_active":"2024-06-11T16:00:06.725941+0000","last_became_peered":"2024-06-11T16:00:06.725941+0000","last_unstale":"2024-06-11T16:00:30.832853+0000","last_undegraded":"2024-06-11T16:00:30.832853+0000","last_fullsized":"2024-06-11T16:00:30.832853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:26.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"55'2","reported_seq":96,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.245192+0000","last_change":"2024-06-11T16:00:06.734401+0000","last_active":"2024-06-11T16:00:32.245192+0000","last_peered":"2024-06-11T16:00:32.245192+0000","last_clean":"2024-06-11T16:00:32.245192+0000","last_became_active":"2024-06-11T16:00:06.733591+0000","last_became_peered":"2024-06-11T16:00:06.733591+0000","last_unstale":"2024-06-11T16:00:32.245192+0000","last_undegraded":"2024-06-11T16:00:32.245192+0000","last_fullsized":"2024-06-11T16:00:32.245192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:53:07.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"55'17","reported_seq":88,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.957018+0000","last_change":"2024-06-11T15:59:29.308305+0000","last_active":"2024-06-11T16:00:32.957018+0000","last_peered":"2024-06-11T16:00:32.957018+0000","last_clean":"2024-06-11T16:00:32.957018+0000","last_became_active":"2024-06-11T15:59:29.307739+0000","last_became_peered":"2024-06-11T15:59:29.307739+0000","last_unstale":"2024-06-11T16:00:32.957018+0000","last_undegraded":"2024-06-11T16:00:32.957018+0000","last_fullsized":"2024-06-11T16:00:32.957018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:37.529774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38531,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833563+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:00:30.833563+0000","last_peered":"2024-06-11T16:00:30.833563+0000","last_clean":"2024-06-11T16:00:30.833563+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:00:30.833563+0000","last_undegraded":"2024-06-11T16:00:30.833563+0000","last_fullsized":"2024-06-11T16:00:30.833563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.832765+0000","last_change":"2024-06-11T16:00:06.731161+0000","last_active":"2024-06-11T16:00:30.832765+0000","last_peered":"2024-06-11T16:00:30.832765+0000","last_clean":"2024-06-11T16:00:30.832765+0000","last_became_active":"2024-06-11T16:00:06.730198+0000","last_became_peered":"2024-06-11T16:00:06.730198+0000","last_unstale":"2024-06-11T16:00:30.832765+0000","last_undegraded":"2024-06-11T16:00:30.832765+0000","last_fullsized":"2024-06-11T16:00:30.832765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:50:45.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"55'15","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.922487+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:00:32.922487+0000","last_peered":"2024-06-11T16:00:32.922487+0000","last_clean":"2024-06-11T16:00:32.922487+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:00:32.922487+0000","last_undegraded":"2024-06-11T16:00:32.922487+0000","last_fullsized":"2024-06-11T16:00:32.922487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":233163,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834215+0000","last_change":"2024-06-11T16:00:06.733390+0000","last_active":"2024-06-11T16:00:30.834215+0000","last_peered":"2024-06-11T16:00:30.834215+0000","last_clean":"2024-06-11T16:00:30.834215+0000","last_became_active":"2024-06-11T16:00:06.733129+0000","last_became_peered":"2024-06-11T16:00:06.733129+0000","last_unstale":"2024-06-11T16:00:30.834215+0000","last_undegraded":"2024-06-11T16:00:30.834215+0000","last_fullsized":"2024-06-11T16:00:30.834215+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:04:02.257999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834316+0000","last_change":"2024-06-11T16:00:06.735376+0000","last_active":"2024-06-11T16:00:30.834316+0000","last_peered":"2024-06-11T16:00:30.834316+0000","last_clean":"2024-06-11T16:00:30.834316+0000","last_became_active":"2024-06-11T16:00:06.734349+0000","last_became_peered":"2024-06-11T16:00:06.734349+0000","last_unstale":"2024-06-11T16:00:30.834316+0000","last_undegraded":"2024-06-11T16:00:30.834316+0000","last_fullsized":"2024-06-11T16:00:30.834316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:57.761478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'11","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.935109+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:00:32.935109+0000","last_peered":"2024-06-11T16:00:32.935109+0000","last_clean":"2024-06-11T16:00:32.935109+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:00:32.935109+0000","last_undegraded":"2024-06-11T16:00:32.935109+0000","last_fullsized":"2024-06-11T16:00:32.935109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18526,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-06-11T16:00:30.834524+0000","last_change":"2024-06-11T15:59:56.403576+0000","last_active":"2024-06-11T16:00:30.834524+0000","last_peered":"2024-06-11T16:00:30.834524+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403576+0000","last_became_peered":"2024-06-11T15:59:56.403576+0000","last_unstale":"2024-06-11T16:00:30.834524+0000","last_undegraded":"2024-06-11T16:00:30.834524+0000","last_fullsized":"2024-06-11T15:59:56.402056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:59:03.781359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833844+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:00:30.833844+0000","last_peered":"2024-06-11T16:00:30.833844+0000","last_clean":"2024-06-11T16:00:30.833844+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:00:30.833844+0000","last_undegraded":"2024-06-11T16:00:30.833844+0000","last_fullsized":"2024-06-11T16:00:30.833844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"55'9","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.029046+0000","last_change":"2024-06-11T16:00:06.730456+0000","last_active":"2024-06-11T16:00:33.029046+0000","last_peered":"2024-06-11T16:00:33.029046+0000","last_clean":"2024-06-11T16:00:33.029046+0000","last_became_active":"2024-06-11T16:00:06.729977+0000","last_became_peered":"2024-06-11T16:00:06.729977+0000","last_unstale":"2024-06-11T16:00:33.029046+0000","last_undegraded":"2024-06-11T16:00:33.029046+0000","last_fullsized":"2024-06-11T16:00:33.029046+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:55:24.550321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833736+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:00:30.833736+0000","last_peered":"2024-06-11T16:00:30.833736+0000","last_clean":"2024-06-11T16:00:30.833736+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:00:30.833736+0000","last_undegraded":"2024-06-11T16:00:30.833736+0000","last_fullsized":"2024-06-11T16:00:30.833736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834667+0000","last_change":"2024-06-11T15:59:29.308481+0000","last_active":"2024-06-11T16:00:30.834667+0000","last_peered":"2024-06-11T16:00:30.834667+0000","last_clean":"2024-06-11T16:00:30.834667+0000","last_became_active":"2024-06-11T15:59:29.307986+0000","last_became_peered":"2024-06-11T15:59:29.307986+0000","last_unstale":"2024-06-11T16:00:30.834667+0000","last_undegraded":"2024-06-11T16:00:30.834667+0000","last_fullsized":"2024-06-11T16:00:30.834667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:20.285064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"55'13","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.076991+0000","last_change":"2024-06-11T16:00:06.733056+0000","last_active":"2024-06-11T16:00:33.076991+0000","last_peered":"2024-06-11T16:00:33.076991+0000","last_clean":"2024-06-11T16:00:33.076991+0000","last_became_active":"2024-06-11T16:00:06.732005+0000","last_became_peered":"2024-06-11T16:00:06.732005+0000","last_unstale":"2024-06-11T16:00:33.076991+0000","last_undegraded":"2024-06-11T16:00:33.076991+0000","last_fullsized":"2024-06-11T16:00:33.076991+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:56:26.626148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29086,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":88,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834313+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:00:30.834313+0000","last_peered":"2024-06-11T16:00:30.834313+0000","last_clean":"2024-06-11T16:00:30.834313+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:00:30.834313+0000","last_undegraded":"2024-06-11T16:00:30.834313+0000","last_fullsized":"2024-06-11T16:00:30.834313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834467+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:00:30.834467+0000","last_peered":"2024-06-11T16:00:30.834467+0000","last_clean":"2024-06-11T16:00:30.834467+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:00:30.834467+0000","last_undegraded":"2024-06-11T16:00:30.834467+0000","last_fullsized":"2024-06-11T16:00:30.834467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"55'17","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.050340+0000","last_change":"2024-06-11T16:00:06.733052+0000","last_active":"2024-06-11T16:00:33.050340+0000","last_peered":"2024-06-11T16:00:33.050340+0000","last_clean":"2024-06-11T16:00:33.050340+0000","last_became_active":"2024-06-11T16:00:06.730909+0000","last_became_peered":"2024-06-11T16:00:06.730909+0000","last_unstale":"2024-06-11T16:00:33.050340+0000","last_undegraded":"2024-06-11T16:00:33.050340+0000","last_fullsized":"2024-06-11T16:00:33.050340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:35.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44240,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"55'9","reported_seq":106,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.209128+0000","last_change":"2024-06-11T16:00:06.761223+0000","last_active":"2024-06-11T16:00:32.209128+0000","last_peered":"2024-06-11T16:00:32.209128+0000","last_clean":"2024-06-11T16:00:32.209128+0000","last_became_active":"2024-06-11T16:00:06.733534+0000","last_became_peered":"2024-06-11T16:00:06.733534+0000","last_unstale":"2024-06-11T16:00:32.209128+0000","last_undegraded":"2024-06-11T16:00:32.209128+0000","last_fullsized":"2024-06-11T16:00:32.209128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:25.557309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-06-11T16:00:30.833962+0000","last_change":"2024-06-11T15:59:56.406049+0000","last_active":"2024-06-11T16:00:30.833962+0000","last_peered":"2024-06-11T16:00:30.833962+0000","last_clean":"2024-06-11T15:58:55.147970+0000","last_became_active":"2024-06-11T15:59:56.406049+0000","last_became_peered":"2024-06-11T15:59:56.406049+0000","last_unstale":"2024-06-11T16:00:30.833962+0000","last_undegraded":"2024-06-11T16:00:30.833962+0000","last_fullsized":"2024-06-11T15:59:56.403036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:56.943518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"55'7","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.907183+0000","last_change":"2024-06-11T16:00:06.732366+0000","last_active":"2024-06-11T16:00:32.907183+0000","last_peered":"2024-06-11T16:00:32.907183+0000","last_clean":"2024-06-11T16:00:32.907183+0000","last_became_active":"2024-06-11T16:00:06.729985+0000","last_became_peered":"2024-06-11T16:00:06.729985+0000","last_unstale":"2024-06-11T16:00:32.907183+0000","last_undegraded":"2024-06-11T16:00:32.907183+0000","last_fullsized":"2024-06-11T16:00:32.907183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:26:03.026776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150466,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"55'19","reported_seq":51,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.838392+0000","last_change":"2024-06-11T16:00:06.732542+0000","last_active":"2024-06-11T16:00:32.838392+0000","last_peered":"2024-06-11T16:00:32.838392+0000","last_clean":"2024-06-11T16:00:32.838392+0000","last_became_active":"2024-06-11T16:00:06.731255+0000","last_became_peered":"2024-06-11T16:00:06.731255+0000","last_unstale":"2024-06-11T16:00:32.838392+0000","last_undegraded":"2024-06-11T16:00:32.838392+0000","last_fullsized":"2024-06-11T16:00:32.838392+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:04:19.929277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93285,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"55'44","reported_seq":102,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.392305+0000","last_change":"2024-06-11T15:59:56.404029+0000","last_active":"2024-06-11T16:00:32.392305+0000","last_peered":"2024-06-11T16:00:32.392305+0000","last_clean":"2024-06-11T15:59:24.509079+0000","last_became_active":"2024-06-11T15:59:56.404029+0000","last_became_peered":"2024-06-11T15:59:56.404029+0000","last_unstale":"2024-06-11T16:00:32.392305+0000","last_undegraded":"2024-06-11T15:59:56.401205+0000","last_fullsized":"2024-06-11T15:59:56.401119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.685489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"55'16","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.010505+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:00:33.010505+0000","last_peered":"2024-06-11T16:00:33.010505+0000","last_clean":"2024-06-11T16:00:33.010505+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:00:33.010505+0000","last_undegraded":"2024-06-11T16:00:33.010505+0000","last_fullsized":"2024-06-11T16:00:33.010505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45554,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"55'5","reported_seq":82,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.237081+0000","last_change":"2024-06-11T15:59:56.407748+0000","last_active":"2024-06-11T16:00:32.237081+0000","last_peered":"2024-06-11T16:00:32.237081+0000","last_clean":"2024-06-11T15:59:45.515376+0000","last_became_active":"2024-06-11T15:59:56.407748+0000","last_became_peered":"2024-06-11T15:59:56.407748+0000","last_unstale":"2024-06-11T16:00:32.237081+0000","last_undegraded":"2024-06-11T15:59:56.405775+0000","last_fullsized":"2024-06-11T15:59:56.405701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:00.944820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834092+0000","last_change":"2024-06-11T16:00:06.729785+0000","last_active":"2024-06-11T16:00:30.834092+0000","last_peered":"2024-06-11T16:00:30.834092+0000","last_clean":"2024-06-11T16:00:30.834092+0000","last_became_active":"2024-06-11T16:00:06.728029+0000","last_became_peered":"2024-06-11T16:00:06.728029+0000","last_unstale":"2024-06-11T16:00:30.834092+0000","last_undegraded":"2024-06-11T16:00:30.834092+0000","last_fullsized":"2024-06-11T16:00:30.834092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:40.886742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'17","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.036991+0000","last_change":"2024-06-11T16:00:06.734202+0000","last_active":"2024-06-11T16:00:33.036991+0000","last_peered":"2024-06-11T16:00:33.036991+0000","last_clean":"2024-06-11T16:00:33.036991+0000","last_became_active":"2024-06-11T16:00:06.733217+0000","last_became_peered":"2024-06-11T16:00:06.733217+0000","last_unstale":"2024-06-11T16:00:33.036991+0000","last_undegraded":"2024-06-11T16:00:33.036991+0000","last_fullsized":"2024-06-11T16:00:33.036991+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:31.247464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51312,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":94,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834250+0000","last_change":"2024-06-11T16:00:06.732126+0000","last_active":"2024-06-11T16:00:30.834250+0000","last_peered":"2024-06-11T16:00:30.834250+0000","last_clean":"2024-06-11T16:00:30.834250+0000","last_became_active":"2024-06-11T16:00:06.731826+0000","last_became_peered":"2024-06-11T16:00:06.731826+0000","last_unstale":"2024-06-11T16:00:30.834250+0000","last_undegraded":"2024-06-11T16:00:30.834250+0000","last_fullsized":"2024-06-11T16:00:30.834250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:40:27.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"55'15","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.068057+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:00:33.068057+0000","last_peered":"2024-06-11T16:00:33.068057+0000","last_clean":"2024-06-11T16:00:33.068057+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:00:33.068057+0000","last_undegraded":"2024-06-11T16:00:33.068057+0000","last_fullsized":"2024-06-11T16:00:33.068057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62916,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"55'16","reported_seq":74,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.990118+0000","last_change":"2024-06-11T16:00:32.514189+0000","last_active":"2024-06-11T16:00:32.990118+0000","last_peered":"2024-06-11T16:00:32.990118+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405793+0000","last_became_peered":"2024-06-11T15:59:56.405793+0000","last_unstale":"2024-06-11T16:00:32.990118+0000","last_undegraded":"2024-06-11T16:00:32.410852+0000","last_fullsized":"2024-06-11T15:59:56.402292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:42:36.697100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75613,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":15}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833767+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:00:30.833767+0000","last_peered":"2024-06-11T16:00:30.833767+0000","last_clean":"2024-06-11T16:00:30.833767+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:00:30.833767+0000","last_undegraded":"2024-06-11T16:00:30.833767+0000","last_fullsized":"2024-06-11T16:00:30.833767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"55'9","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.053030+0000","last_change":"2024-06-11T16:00:06.733930+0000","last_active":"2024-06-11T16:00:33.053030+0000","last_peered":"2024-06-11T16:00:33.053030+0000","last_clean":"2024-06-11T16:00:33.053030+0000","last_became_active":"2024-06-11T16:00:06.733386+0000","last_became_peered":"2024-06-11T16:00:06.733386+0000","last_unstale":"2024-06-11T16:00:33.053030+0000","last_undegraded":"2024-06-11T16:00:33.053030+0000","last_fullsized":"2024-06-11T16:00:33.053030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:38:34.805513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17247,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":93,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833349+0000","last_change":"2024-06-11T16:00:06.735029+0000","last_active":"2024-06-11T16:00:30.833349+0000","last_peered":"2024-06-11T16:00:30.833349+0000","last_clean":"2024-06-11T16:00:30.833349+0000","last_became_active":"2024-06-11T16:00:06.733409+0000","last_became_peered":"2024-06-11T16:00:06.733409+0000","last_unstale":"2024-06-11T16:00:30.833349+0000","last_undegraded":"2024-06-11T16:00:30.833349+0000","last_fullsized":"2024-06-11T16:00:30.833349+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"55'16","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.977772+0000","last_change":"2024-06-11T16:00:06.731080+0000","last_active":"2024-06-11T16:00:32.977772+0000","last_peered":"2024-06-11T16:00:32.977772+0000","last_clean":"2024-06-11T16:00:32.977772+0000","last_became_active":"2024-06-11T16:00:06.727597+0000","last_became_peered":"2024-06-11T16:00:06.727597+0000","last_unstale":"2024-06-11T16:00:32.977772+0000","last_undegraded":"2024-06-11T16:00:32.977772+0000","last_fullsized":"2024-06-11T16:00:32.977772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:52:27.028359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20159,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833249+0000","last_change":"2024-06-11T15:59:29.305122+0000","last_active":"2024-06-11T16:00:30.833249+0000","last_peered":"2024-06-11T16:00:30.833249+0000","last_clean":"2024-06-11T16:00:30.833249+0000","last_became_active":"2024-06-11T15:59:29.304793+0000","last_became_peered":"2024-06-11T15:59:29.304793+0000","last_unstale":"2024-06-11T16:00:30.833249+0000","last_undegraded":"2024-06-11T16:00:30.833249+0000","last_fullsized":"2024-06-11T16:00:30.833249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:30:40.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"55'11","reported_seq":82,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.042633+0000","last_change":"2024-06-11T15:59:29.308065+0000","last_active":"2024-06-11T16:00:33.042633+0000","last_peered":"2024-06-11T16:00:33.042633+0000","last_clean":"2024-06-11T16:00:33.042633+0000","last_became_active":"2024-06-11T15:59:29.307541+0000","last_became_peered":"2024-06-11T15:59:29.307541+0000","last_unstale":"2024-06-11T16:00:33.042633+0000","last_undegraded":"2024-06-11T16:00:33.042633+0000","last_fullsized":"2024-06-11T16:00:33.042633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:01:30.960914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26438,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833386+0000","last_change":"2024-06-11T16:00:06.733548+0000","last_active":"2024-06-11T16:00:30.833386+0000","last_peered":"2024-06-11T16:00:30.833386+0000","last_clean":"2024-06-11T16:00:30.833386+0000","last_became_active":"2024-06-11T16:00:06.732173+0000","last_became_peered":"2024-06-11T16:00:06.732173+0000","last_unstale":"2024-06-11T16:00:30.833386+0000","last_undegraded":"2024-06-11T16:00:30.833386+0000","last_fullsized":"2024-06-11T16:00:30.833386+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:49.916407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"55'15","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.935811+0000","last_change":"2024-06-11T16:00:06.732865+0000","last_active":"2024-06-11T16:00:32.935811+0000","last_peered":"2024-06-11T16:00:32.935811+0000","last_clean":"2024-06-11T16:00:32.935811+0000","last_became_active":"2024-06-11T16:00:06.731899+0000","last_became_peered":"2024-06-11T16:00:06.731899+0000","last_unstale":"2024-06-11T16:00:32.935811+0000","last_undegraded":"2024-06-11T16:00:32.935811+0000","last_fullsized":"2024-06-11T16:00:32.935811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:26:57.512382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3797831,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.833994+0000","last_change":"2024-06-11T16:00:06.742695+0000","last_active":"2024-06-11T16:00:30.833994+0000","last_peered":"2024-06-11T16:00:30.833994+0000","last_clean":"2024-06-11T16:00:30.833994+0000","last_became_active":"2024-06-11T16:00:06.729796+0000","last_became_peered":"2024-06-11T16:00:06.729796+0000","last_unstale":"2024-06-11T16:00:30.833994+0000","last_undegraded":"2024-06-11T16:00:30.833994+0000","last_fullsized":"2024-06-11T16:00:30.833994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:42:13.786513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'16","reported_seq":61,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:33.007275+0000","last_change":"2024-06-11T16:00:06.731819+0000","last_active":"2024-06-11T16:00:33.007275+0000","last_peered":"2024-06-11T16:00:33.007275+0000","last_clean":"2024-06-11T16:00:33.007275+0000","last_became_active":"2024-06-11T16:00:06.731150+0000","last_became_peered":"2024-06-11T16:00:06.731150+0000","last_unstale":"2024-06-11T16:00:33.007275+0000","last_undegraded":"2024-06-11T16:00:33.007275+0000","last_fullsized":"2024-06-11T16:00:33.007275+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:55:26.515232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82931,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"55'3","reported_seq":37,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834476+0000","last_change":"2024-06-11T16:00:06.753989+0000","last_active":"2024-06-11T16:00:30.834476+0000","last_peered":"2024-06-11T16:00:30.834476+0000","last_clean":"2024-06-11T16:00:30.834476+0000","last_became_active":"2024-06-11T16:00:06.731991+0000","last_became_peered":"2024-06-11T16:00:06.731991+0000","last_unstale":"2024-06-11T16:00:30.834476+0000","last_undegraded":"2024-06-11T16:00:30.834476+0000","last_fullsized":"2024-06-11T16:00:30.834476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:35:10.544048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"55'11","reported_seq":82,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:32.851473+0000","last_change":"2024-06-11T15:59:29.308075+0000","last_active":"2024-06-11T16:00:32.851473+0000","last_peered":"2024-06-11T16:00:32.851473+0000","last_clean":"2024-06-11T16:00:32.851473+0000","last_became_active":"2024-06-11T15:59:29.307570+0000","last_became_peered":"2024-06-11T15:59:29.307570+0000","last_unstale":"2024-06-11T16:00:32.851473+0000","last_undegraded":"2024-06-11T16:00:32.851473+0000","last_fullsized":"2024-06-11T16:00:32.851473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:41.270065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22626,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":87,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834275+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:00:30.834275+0000","last_peered":"2024-06-11T16:00:30.834275+0000","last_clean":"2024-06-11T16:00:30.834275+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:00:30.834275+0000","last_undegraded":"2024-06-11T16:00:30.834275+0000","last_fullsized":"2024-06-11T16:00:30.834275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"55'19","reported_seq":59,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:32.960691+0000","last_change":"2024-06-11T16:00:32.494350+0000","last_active":"2024-06-11T16:00:32.960691+0000","last_peered":"2024-06-11T16:00:32.960691+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.402742+0000","last_became_peered":"2024-06-11T15:59:56.402742+0000","last_unstale":"2024-06-11T16:00:32.960691+0000","last_undegraded":"2024-06-11T16:00:32.487646+0000","last_fullsized":"2024-06-11T15:59:56.400903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:17:00.768242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41944,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":19}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":103,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-06-11T16:00:30.834115+0000","last_change":"2024-06-11T16:00:06.745478+0000","last_active":"2024-06-11T16:00:30.834115+0000","last_peered":"2024-06-11T16:00:30.834115+0000","last_clean":"2024-06-11T16:00:30.834115+0000","last_became_active":"2024-06-11T16:00:06.729808+0000","last_became_peered":"2024-06-11T16:00:06.729808+0000","last_unstale":"2024-06-11T16:00:30.834115+0000","last_undegraded":"2024-06-11T16:00:30.834115+0000","last_fullsized":"2024-06-11T16:00:30.834115+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:19.971127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":17390236,"num_objects":903,"num_object_clones":0,"num_object_copies":1806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":152,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":903,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":916,"num_write_kb":17541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32112640,"data_stored":29917811,"data_compressed":1528046,"data_compressed_allocated":1789952,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":920,"ondisk_log_size":920,"up":118,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":347916,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":100,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":652,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":356827,"data_compressed":38450,"data_compressed_allocated":57344,"data_compressed_original":212992,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":56,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":722699,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738393,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42848,"kb_used_data":11672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328992,"statfs":{"total":96636764160,"available":96592887808,"internally_reserved":0,"allocated":11952128,"data_stored":12255854,"data_compressed":643244,"data_compressed_allocated":757760,"data_compressed_original":2011136,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47220,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324620,"statfs":{"total":96636764160,"available":96588410880,"internally_reserved":0,"allocated":16429056,"data_stored":16703209,"data_compressed":718637,"data_compressed_allocated":831488,"data_compressed_original":2195456,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":347882,"data_compressed":38450,"data_compressed_allocated":57344,"data_compressed_original":212992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18292736,"data_stored":17201176,"data_compressed":799372,"data_compressed_allocated":933888,"data_compressed_original":2129920,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13819904,"data_stored":12716635,"data_compressed":728674,"data_compressed_allocated":856064,"data_compressed_original":1949696,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:00:34.591 INFO:tasks.thrashosds.thrasher:Setting 3.14 to [2, 1] 2024-06-11T16:00:34.591 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.14', '2', '1'] 2024-06-11T16:00:34.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.14 2 1 2024-06-11T16:00:34.610 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.610 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.617 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:34.618+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:34.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:34.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:34.719+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:34.737 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.737 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.747 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:34.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:34.832+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:34.909 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:34.909 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:34.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:34.920+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:34.920 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:35.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:35.021+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:35.036 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:35.036 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:35.045 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:35.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:35.123+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:35.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:35.162 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:35.162 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:35.173 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:35.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:35.223+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:35.281 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:35.281 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:35.294 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:35.294 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:35.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:35.294 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.097325163999997, 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061865490000000004, 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:35.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196501+0000", 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196508+0000", 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5169999999999996e-06 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196516+0000", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3469999999999999e-06 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196529+0000", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2734e-05 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196600+0000", 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1043000000000004e-05 2024-06-11T16:00:35.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198009+0000", 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001408875 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198123+0000", 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011410599999999999 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198254+0000", 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013118 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202057+0000", 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038027479999999999 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202625+0000", 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056805600000000005 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202657+0000", 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2302999999999999e-05 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202688+0000", 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0639999999999998e-05 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.097168174000004, 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:35.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:35.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:35.306 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.097127764999996, 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0075119669999999996, 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196698+0000", 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196699+0000", 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1600000000000001e-07 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196704+0000", 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0270000000000003e-06 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196713+0000", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7690000000000002e-06 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196729+0000", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6609999999999999e-05 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200589+0000", 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038591540000000001 2024-06-11T16:00:35.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200692+0000", 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102963 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200812+0000", 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012082399999999999 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202606+0000", 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001793198 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204157+0000", 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0015514109999999999 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204187+0000", 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0328000000000002e-05 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204210+0000", 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3067000000000001e-05 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.097054045999997, 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0078360619999999995, 2024-06-11T16:00:35.312 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196772+0000", 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196773+0000", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8599999999999997e-07 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196778+0000", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0669999999999999e-06 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196786+0000", 2024-06-11T16:00:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6070000000000002e-06 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196792+0000", 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9199999999999998e-06 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201145+0000", 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043523989999999999 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201289+0000", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144146 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201489+0000", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019981400000000001 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202730+0000", 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001241411 2024-06-11T16:00:35.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204496+0000", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017654960000000001 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204550+0000", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4273e-05 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204608+0000", 2024-06-11T16:00:35.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8143000000000002e-05 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.096916586000006, 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.318 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:35.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:35.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.323 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.096882782999998, 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079058940000000001, 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196943+0000", 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196944+0000", 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6000000000000004e-07 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196958+0000", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4049000000000001e-05 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196972+0000", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3637e-05 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196978+0000", 2024-06-11T16:00:35.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4899999999999997e-06 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197364+0000", 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038633599999999998 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197545+0000", 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018029 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198002+0000", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045678400000000001 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201526+0000", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035244429999999999 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204795+0000", 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003268834 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204826+0000", 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1198999999999997e-05 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204849+0000", 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3272e-05 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.329 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.096577988000007, 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:35.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:35.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.333 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 96.096495727000004, 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:35.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.8220086019999999, 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.338 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:35.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:35.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:35.343 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.1100726509999999, 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:35.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:35.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:35.349 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.104874793, 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:35.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:35.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.355 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:32 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~1337428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.091836942, 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082427049999999995, 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201991+0000", 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9250000000000002e-06 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203544+0000", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001552903 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203555+0000", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1316e-05 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203568+0000", 2024-06-11T16:00:35.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2955e-05 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203621+0000", 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2667999999999998e-05 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203719+0000", 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8268000000000002e-05 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203806+0000", 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206690+0000", 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028845720000000002 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210148+0000", 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034572639999999998 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210191+0000", 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3559000000000001e-05 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210232+0000", 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0674999999999999e-05 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:80 3.17 3:eaf075c4:::500.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:35.361 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0577186369999998, 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060625180000000002, 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236108+0000", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7000000000000001e-07 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236109+0000", 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5239999999999999e-06 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236114+0000", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.006e-06 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236117+0000", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0869999999999998e-06 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236166+0000", 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8355e-05 2024-06-11T16:00:35.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236264+0000", 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7866000000000001e-05 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242170+0000", 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00590641 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:82 3.6 3:66eb7180:::500.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0577013100000001, 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060403790000000002, 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236125+0000", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.53e-07 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236127+0000", 2024-06-11T16:00:35.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1710000000000001e-06 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236133+0000", 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9100000000000002e-06 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236138+0000", 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8940000000000001e-06 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236178+0000", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9357000000000003e-05 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236282+0000", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010432799999999999 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242165+0000", 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058833660000000001 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.369 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:83 3.1d 3:bb63c54e:::500.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0576809059999999, 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060198439999999999, 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236145+0000", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236146+0000", 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7300000000000001e-07 2024-06-11T16:00:35.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236148+0000", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.872e-06 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236153+0000", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8200000000000002e-06 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236158+0000", 2024-06-11T16:00:35.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8539999999999996e-06 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236206+0000", 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7422000000000001e-05 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236272+0000", 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6777000000000001e-05 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242165+0000", 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058926259999999998 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:84 3.b 3:d5442d2d:::500.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0576554150000002, 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0060574729999999999, 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236171+0000", 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1199999999999998e-07 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236173+0000", 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3290000000000001e-06 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236180+0000", 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0399999999999998e-06 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236186+0000", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1619999999999996e-06 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236226+0000", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9854000000000002e-05 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.236316+0000", 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0808000000000002e-05 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.242228+0000", 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059118679999999998 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:39 4.1a 4:582f7b2d:::10000000226.00000000:head [write 0~32] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.9259967410000001, 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0056282809999999997, 2024-06-11T16:00:35.378 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 39 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367829+0000", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367830+0000", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000004e-07 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367834+0000", 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1250000000000003e-06 2024-06-11T16:00:35.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367848+0000", 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3737000000000001e-05 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367854+0000", 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1449999999999996e-06 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.367925+0000", 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0356000000000002e-05 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368024+0000", 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9259000000000006e-05 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368141+0000", 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117178 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.368833+0000", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00069172199999999997 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373386+0000", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045532120000000001 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373421+0000", 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4918e-05 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.373458+0000", 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6859000000000001e-05 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:51 4.13 4:c8893608:::1000000023c.00000000:head [write 0~20657] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.8815286229999999, 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057502159999999998, 2024-06-11T16:00:35.384 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 51 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412298+0000", 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5700000000000001e-07 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412319+0000", 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0965e-05 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412329+0000", 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6730000000000004e-06 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412334+0000", 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2299999999999999e-06 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412371+0000", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6297999999999997e-05 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412448+0000", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7390000000000003e-05 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.412532+0000", 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4474999999999993e-05 2024-06-11T16:00:35.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.413264+0000", 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00073109 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.417963+0000", 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0046991380000000003 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.418011+0000", 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7939999999999998e-05 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.418048+0000", 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7160000000000003e-05 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:56 4.13 4:c933d8fa:::10000000241.00000000:head [write 0~910] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:35.390 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.878929855, 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057045259999999997, 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 56 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:35.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414896+0000", 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414897+0000", 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9400000000000004e-07 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414904+0000", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5150000000000003e-06 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414912+0000", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7460000000000006e-06 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414917+0000", 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4410000000000003e-06 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.414954+0000", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6699000000000002e-05 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415046+0000", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2520000000000002e-05 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415111+0000", 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5109000000000003e-05 2024-06-11T16:00:35.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415709+0000", 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00059769700000000001 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420530+0000", 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048209739999999996 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420573+0000", 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3021e-05 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420601+0000", 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8010000000000001e-05 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:57 4.2e 4:7528f44f:::10000000242.00000000:head [write 0~115] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:35.396 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.8784468360000002, 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052770380000000004, 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 57 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:35.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415379+0000", 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415380+0000", 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5899999999999996e-07 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415383+0000", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1829999999999998e-06 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415390+0000", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4239999999999998e-06 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415394+0000", 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3989999999999997e-06 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415430+0000", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5911999999999998e-05 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415497+0000", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7488000000000002e-05 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.415565+0000", 2024-06-11T16:00:35.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7799000000000006e-05 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.416137+0000", 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00057144100000000001 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420552+0000", 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0044154149999999998 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:35.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420618+0000", 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6118000000000006e-05 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.420656+0000", 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.82e-05 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:35.402 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:35.403 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:35.404 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:35.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:35.405 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:35.406 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:35.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:35.404+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:35.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:35.505+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:35.523 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3815 4.36 e56/33 4:6f41bf00:::1000000110e.00000000:head v 56'57, mlcod=56'55)", 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0076992720000000001, 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077129299999999998, 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516837+0000", 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.27e-07 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516840+0000", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2169999999999999e-06 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516848+0000", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1130000000000001e-06 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516853+0000", 2024-06-11T16:00:35.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9490000000000004e-06 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516889+0000", 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5540999999999997e-05 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516900+0000", 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1669e-05 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3816 4.36 e56/33 4:6ebc5ac6:::1000000110f.00000000:head v 56'58, mlcod=56'55)", 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0069986629999999996, 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070472390000000003, 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517538+0000", 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8599999999999998e-07 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517552+0000", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4517e-05 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517562+0000", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5780000000000005e-06 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517567+0000", 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7720000000000002e-06 2024-06-11T16:00:35.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517595+0000", 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8847e-05 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517606+0000", 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0185e-05 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3817 4.3c e56/43 4:3d01cf74:::10000001110.00000000:head v 56'46, mlcod=56'44)", 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0063311729999999998, 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064096079999999998, 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518208+0000", 2024-06-11T16:00:35.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1259999999999998e-06 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518215+0000", 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6989999999999997e-06 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518225+0000", 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0275000000000001e-05 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518262+0000", 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6782000000000001e-05 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518273+0000", 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1473e-05 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.535 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3818 4.36 e56/33 4:6f6907fb:::10000001111.00000000:head v 56'59, mlcod=56'55)", 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.518940+0000", 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0055958479999999996, 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057036739999999997, 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518940+0000", 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518940+0000", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518940+0000", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8699999999999995e-07 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518953+0000", 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2712e-05 2024-06-11T16:00:35.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518963+0000", 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9000000000000001e-06 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518972+0000", 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7320000000000004e-06 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519010+0000", 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8234e-05 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519021+0000", 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631e-05 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3819 4.10 e56/17 4:0ade047f:::10000001112.00000000:head v 56'56, mlcod=56'54)", 2024-06-11T16:00:35.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.519665+0000", 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0048706579999999999, 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050252120000000003, 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519665+0000", 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519665+0000", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519666+0000", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.82e-07 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519670+0000", 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0890000000000002e-06 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519680+0000", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7880000000000001e-06 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519684+0000", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8629999999999999e-06 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519726+0000", 2024-06-11T16:00:35.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1198000000000001e-05 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.519739+0000", 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3061000000000001e-05 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3820 4.0 e56/43 4:013436f4:::10000001113.00000000:head v 56'50, mlcod=56'48)", 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.520369+0000", 2024-06-11T16:00:35.543 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0041671800000000004, 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043786989999999998, 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520369+0000", 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520369+0000", 2024-06-11T16:00:35.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520369+0000", 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8800000000000002e-07 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520373+0000", 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1110000000000001e-06 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520383+0000", 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4609999999999997e-06 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520387+0000", 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5600000000000004e-06 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520417+0000", 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9317999999999999e-05 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.520427+0000", 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0257e-05 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3821 4.6 e56/24 4:63c7e114:::10000001114.00000000:head v 56'60, mlcod=56'58)", 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.521058+0000", 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0034773019999999998, 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0037481559999999999, 2024-06-11T16:00:35.547 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521058+0000", 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521058+0000", 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521059+0000", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7800000000000001e-07 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521063+0000", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.42e-06 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521073+0000", 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7620000000000007e-06 2024-06-11T16:00:35.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521078+0000", 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.617e-06 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521126+0000", 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8415999999999999e-05 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521147+0000", 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0908999999999999e-05 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3824 4.6 e56/24 4:63719fb0:::10000001117.00000000:head v 56'61, mlcod=56'58)", 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.523372+0000", 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0011641170000000001, 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014878669999999999, 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.551 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523372+0000", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523372+0000", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523372+0000", 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8599999999999998e-07 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523376+0000", 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9740000000000004e-06 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523386+0000", 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6690000000000001e-06 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523390+0000", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5850000000000001e-06 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523425+0000", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4504e-05 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.523438+0000", 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3219e-05 2024-06-11T16:00:35.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3825 4.2b e56/43 4:d7d2fc3d:::10000001118.00000000:head v 56'66, mlcod=56'64)", 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.524155+0000", 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.000381183, 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00076406800000000002, 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524155+0000", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524155+0000", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524155+0000", 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3799999999999998e-07 2024-06-11T16:00:35.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524158+0000", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.971e-06 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524164+0000", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6200000000000001e-06 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524168+0000", 2024-06-11T16:00:35.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3249999999999999e-06 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524201+0000", 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2818999999999999e-05 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524213+0000", 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2816000000000001e-05 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3826 4.1e e56/43 4:793b70a8:::10000001119.00000000:head v 56'60, mlcod=56'58)", 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.524775+0000", 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9997602, 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020080599999999999, 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524775+0000", 2024-06-11T16:00:35.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524775+0000", 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524776+0000", 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7999999999999996e-07 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524780+0000", 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9149999999999998e-06 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524787+0000", 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8700000000000003e-06 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524791+0000", 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3950000000000003e-06 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524821+0000", 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0403999999999999e-05 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524836+0000", 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4279e-05 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.562 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-06-11T16:00:35.563 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 10 2024-06-11T16:00:35.563 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:35.564 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:35.605 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:35.606+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:35.706 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:35.706+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:35.722 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:35.722 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:35.722 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:35.731 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:35.806 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:35.807+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:35.841 INFO:teuthology.orchestra.run.smithi089.stderr:set 3.14 pg_upmap mapping to [2,1] 2024-06-11T16:00:35.847 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:35.847 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:35.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:35.847 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649489192999994, 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:35.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:35.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.853 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649373924000002, 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:35.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649342122999997, 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:35.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649285359000004, 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:35.865 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:35.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.872 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649258857000007, 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.873 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:35.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:35.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:35.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:35.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:35.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:35.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649229809999994, 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.886 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.887 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:35.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:35.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:35.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:35.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:35.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:35.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:35.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.898 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649178751999997, 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:35.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.649127118999999, 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:35.904 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:35.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:35.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.6577064459999997, 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:35.909 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:35.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.6507486829999998, 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:35.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:32 4.2e e55/33 4:7611a124:::1000000021e.00000000:head v 55'2, mlcod=0'0)", 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.643238786, 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061699179999999999, 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:35.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203930+0000", 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205146+0000", 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012159899999999999 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205158+0000", 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2302e-05 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205166+0000", 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5820000000000004e-06 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205216+0000", 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0355999999999997e-05 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205233+0000", 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7371e-05 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210073+0000", 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048391069999999996 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210099+0000", 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6669000000000002e-05 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3618 4.3c e56/43 4:3d3cb2dc:::10000001049.00000000:head v 56'40, mlcod=56'37)", 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:35.924 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.47771281700000001, 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062099750000000004, 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369462+0000", 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5969999999999997e-06 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369472+0000", 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0343000000000001e-05 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369497+0000", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4661999999999999e-05 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369509+0000", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.172e-05 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369633+0000", 2024-06-11T16:00:35.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012426099999999999 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369691+0000", 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7834999999999998e-05 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.375635+0000", 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059441989999999998 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.375665+0000", 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0358e-05 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3638 4.0 e56/43 4:026655a4:::1000000105d.00000000:head v 56'48, mlcod=56'46)", 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.46347217200000002, 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061692960000000003, 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.929 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383697+0000", 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383703+0000", 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.861e-06 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383713+0000", 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7000000000000003e-06 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383718+0000", 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8029999999999996e-06 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383761+0000", 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2935000000000001e-05 2024-06-11T16:00:35.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383777+0000", 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.666e-05 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.389809+0000", 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060312869999999998 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.389865+0000", 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6483000000000001e-05 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3813 4.2a e56/43 4:56e14134:::1000000110c.00000000:head v 56'63, mlcod=56'61)", 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.33189296200000001, 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066189489999999998, 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0699999999999998e-07 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515278+0000", 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7410000000000001e-06 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515284+0000", 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0390000000000001e-06 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515287+0000", 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1820000000000002e-06 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515317+0000", 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9124000000000001e-05 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515327+0000", 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.057e-05 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521854+0000", 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065272150000000003 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521894+0000", 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9771000000000003e-05 2024-06-11T16:00:35.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.14414.0:3814 4.1f 4:f81ce58e:::1000000110d.00000000:head [write 0~1270] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.331400633, 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062152459999999998, 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.941 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.14414", 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 3814 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515768+0000", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.68e-07 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515771+0000", 2024-06-11T16:00:35.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.32e-06 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515779+0000", 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9030000000000004e-06 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515783+0000", 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0980000000000004e-06 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515817+0000", 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3902999999999997e-05 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515891+0000", 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3782999999999995e-05 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521865+0000", 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059738940000000004 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521897+0000", 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2401999999999999e-05 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521983+0000", 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5274999999999999e-05 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.946 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3815 4.36 e56/33 4:6f41bf00:::1000000110e.00000000:head v 56'57, mlcod=56'55)", 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.33033167200000002, 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078896599999999997, 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516837+0000", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.27e-07 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516840+0000", 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2169999999999999e-06 2024-06-11T16:00:35.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516848+0000", 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1130000000000001e-06 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516853+0000", 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9490000000000004e-06 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516889+0000", 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5540999999999997e-05 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516900+0000", 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1669e-05 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524693+0000", 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077925499999999997 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524726+0000", 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3194000000000001e-05 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3816 4.36 e56/33 4:6ebc5ac6:::1000000110f.00000000:head v 56'58, mlcod=56'55)", 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.329631063, 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072148300000000002, 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.951 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517538+0000", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8599999999999998e-07 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517552+0000", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4517e-05 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517562+0000", 2024-06-11T16:00:35.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5780000000000005e-06 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517567+0000", 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7720000000000002e-06 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517595+0000", 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8847e-05 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517606+0000", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0185e-05 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524729+0000", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071232409999999998 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524752+0000", 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3104000000000001e-05 2024-06-11T16:00:35.955 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3817 4.3c e56/43 4:3d01cf74:::10000001110.00000000:head v 56'46, mlcod=56'44)", 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.32896357300000001, 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065498600000000002, 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518208+0000", 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1259999999999998e-06 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518215+0000", 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6989999999999997e-06 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518225+0000", 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0275000000000001e-05 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518262+0000", 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6782000000000001e-05 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518273+0000", 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1473e-05 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524729+0000", 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064555330000000003 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524754+0000", 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5587000000000001e-05 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:4101 4.2f e56/17 4:f60489f4:::1000000122c.00000000:head v 56'72, mlcod=56'70)", 2024-06-11T16:00:35.960 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.10341338, 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0074973160000000004, 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743759+0000", 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7230000000000002e-06 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743768+0000", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7860000000000002e-06 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743773+0000", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3079999999999998e-06 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743812+0000", 2024-06-11T16:00:35.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8722e-05 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743825+0000", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2683999999999999e-05 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751222+0000", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00739728 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751252+0000", 2024-06-11T16:00:35.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0246000000000001e-05 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:4102 4.25 e56/43 4:a5af3e67:::1000000122d.00000000:head v 56'54, mlcod=56'52)", 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.10268174400000001, 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006826197, 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:35.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:35.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744487+0000", 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744493+0000", 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.314e-06 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744502+0000", 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.456e-06 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744506+0000", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3290000000000004e-06 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744553+0000", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7407999999999997e-05 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744573+0000", 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0094000000000001e-05 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751259+0000", 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066857039999999998 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751313+0000", 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3381999999999998e-05 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:35.969 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:35.970 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:35.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:00:35.972 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:35.973 INFO:tasks.workunit.client.0.smithi089.stderr:Updating files: 28% (1217/4278) Updating files: 29% (1241/4278) Updating files: 30% (1284/4278) Updating files: 31% (1327/4278) Updating files: 32% (1369/4278) Updating files: 33% (1412/4278) Updating files: 34% (1455/4278) Updating files: 35% (1498/4278) Updating files: 36% (1541/4278) Updating files: 37% (1583/4278) Updating files: 38% (1626/4278) Updating files: 39% (1669/4278) Updating files: 40% (1712/4278) Updating files: 41% (1754/4278) Updating files: 42% (1797/4278) Updating files: 43% (1840/4278) Updating files: 44% (1883/4278) Updating files: 45% (1926/4278) Updating files: 46% (1968/4278) Updating files: 47% (2011/4278) Updating files: 48% (2054/4278) Updating files: 49% (2097/4278) Updating files: 50% (2139/4278) Updating files: 51% (2182/4278) Updating files: 52% (2225/4278) Updating files: 53% (2268/4278) Updating files: 54% (2311/4278) Updating files: 55% (2353/4278) Updating files: 56% (2396/4278) Updating files: 57% (2439/4278) Updating files: 57% (2449/4278) Updating files: 58% (2482/4278) Updating files: 59% (2525/4278) Updating files: 60% (2567/4278) Updating files: 61% (2610/4278) Updating files: 62% (2653/4278) Updating files: 63% (2696/4278) Updating files: 64% (2738/4278) Updating files: 65% (2781/4278) Updating files: 66% (2824/4278) Updating files: 67% (2867/4278) Updating files: 68% (2910/4278) Updating files: 69% (2952/4278) Updating files: 70% (2995/4278) Updating files: 71% (3038/4278) Updating files: 72% (3081/4278) Updating files: 73% (3123/4278) Updating files: 74% (3166/4278) Updating files: 75% (3209/4278) Updating files: 76% (3252/4278) Updating files: 77% (3295/4278) Updating files: 78% (3337/4278) Updating files: 79% (3380/4278) Updating files: 80% (3423/4278) Updating files: 81% (3466/4278) Updating files: 82% (3508/4278) Updating files: 83% (3551/4278) Updating files: 84% (3594/4278) Updating files: 84% (3625/4278) Updating files: 85% (3637/4278) Updating files: 86% (3680/4278) Updating files: 87% (3722/4278) Updating files: 88% (3765/4278) Updating files: 89% (3808/4278) Updating files: 90% (3851/4278) Updating files: 91% (3893/4278) Updating files: 92% (3936/4278) Updating files: 93% (3979/4278) Updating files: 94% (4022/4278) Updating files: 95% (4065/4278) Updating files: 96% (4107/4278) Updating files: 97% (4150/4278) Updating files: 98% (4193/4278) Updating files: 99% (4236/4278) Updating files: 100% (4278/4278) Updating files: 100% (4278/4278), done. 2024-06-11T16:00:35.973 INFO:tasks.workunit.client.0.smithi089.stderr:+ cd xfstests-dev 2024-06-11T16:00:35.973 INFO:tasks.workunit.client.0.smithi089.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-06-11T16:00:35.974 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:35.972+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:36.073+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:36.078 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:36.078 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:36.078 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:36.078 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:36.087 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:36.173 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.174+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.191 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:36.191 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:36.191 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:36.191 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:36.191 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:36.200 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:36.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:36.276+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.347 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 97.150104799999994, 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:36.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:36.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.353 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:36.354 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 97.149853211999996, 2024-06-11T16:00:36.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:36.354 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.354 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.354 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 97.149514613999997, 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.360 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:36.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 97.149432352999995, 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.364 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.8749452279999996, 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.368 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1630092770000005, 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.373 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:36.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:36.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1578114189999997, 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:36.379 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:36.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:36.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:32 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~1337428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1447735679999997, 2024-06-11T16:00:36.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082427049999999995, 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:36.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201991+0000", 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9250000000000002e-06 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203544+0000", 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001552903 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203555+0000", 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1316e-05 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203568+0000", 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2955e-05 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203621+0000", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2667999999999998e-05 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203719+0000", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8268000000000002e-05 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203806+0000", 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-06-11T16:00:36.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206690+0000", 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028845720000000002 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210148+0000", 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034572639999999998 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210191+0000", 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3559000000000001e-05 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210232+0000", 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0674999999999999e-05 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3582 4.3a 4:5cd099ca:::10000001025.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:36.391 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.0039957930000001, 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080868590000000001, 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3582 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:36.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342768+0000", 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342772+0000", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7049999999999998e-06 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342780+0000", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9459999999999998e-06 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342785+0000", 2024-06-11T16:00:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4379999999999997e-06 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342828+0000", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3135e-05 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342946+0000", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118181 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.343064+0000", 2024-06-11T16:00:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118096 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.344810+0000", 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017457880000000001 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350771+0000", 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059614230000000004 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350819+0000", 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7706e-05 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350854+0000", 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4851000000000002e-05 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.398 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3770 4.19 4:982578ba:::100000010e1.00000000:head [write 0~1622] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86456212700000001, 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0086915499999999993, 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3770 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2699999999999999e-07 2024-06-11T16:00:36.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482205+0000", 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9589999999999997e-06 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482213+0000", 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000008e-06 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482217+0000", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1409999999999998e-06 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482251+0000", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3940999999999999e-05 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482318+0000", 2024-06-11T16:00:36.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7057000000000005e-05 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482393+0000", 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5356000000000002e-05 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483398+0000", 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001004944 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490809+0000", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074110900000000004 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490852+0000", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2324999999999999e-05 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490892+0000", 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0410000000000001e-05 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.404 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3771 4.9 4:90e0489c:::100000010e2.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.482988+0000", 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86377494200000005, 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079862619999999992, 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3771 2024-06-11T16:00:36.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482988+0000", 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482988+0000", 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482989+0000", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4600000000000004e-07 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482992+0000", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7589999999999999e-06 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483004+0000", 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1629e-05 2024-06-11T16:00:36.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483009+0000", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0699999999999997e-06 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483053+0000", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3662000000000003e-05 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483172+0000", 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011954499999999999 2024-06-11T16:00:36.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483326+0000", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000153771 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.484295+0000", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00096866200000000002 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490900+0000", 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0066051510000000001 2024-06-11T16:00:36.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490941+0000", 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1313000000000002e-05 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490974+0000", 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2954000000000003e-05 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3772 4.17 4:e8a95beb:::100000010e3.00000000:head [write 0~2546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86302090799999998, 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082916239999999992, 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3772 2024-06-11T16:00:36.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483743+0000", 2024-06-11T16:00:36.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6400000000000001e-07 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483747+0000", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2540000000000003e-06 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483757+0000", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0477e-05 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483763+0000", 2024-06-11T16:00:36.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1850000000000003e-06 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483802+0000", 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9239000000000002e-05 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483876+0000", 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4433999999999999e-05 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491895+0000", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080190130000000002 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491943+0000", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7834000000000003e-05 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.492034+0000", 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0424e-05 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.415 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3815 4.36 4:6f41bf00:::1000000110e.00000000:head [write 0~117] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.83027198400000002, 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084138389999999993, 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3815 2024-06-11T16:00:36.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516492+0000", 2024-06-11T16:00:36.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.61e-07 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516495+0000", 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8139999999999998e-06 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516506+0000", 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0669000000000001e-05 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516511+0000", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3029999999999999e-06 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516556+0000", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5138e-05 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516654+0000", 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7398000000000005e-05 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516738+0000", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4473000000000003e-05 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.517649+0000", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00091060100000000003 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524816+0000", 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071670950000000001 2024-06-11T16:00:36.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524865+0000", 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8573999999999999e-05 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524905+0000", 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0012999999999998e-05 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3908 4.c 4:30766283:::1000000116b.00000000:head [write 0~1951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.76134149600000001, 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082139840000000006, 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.422 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3908 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585422+0000", 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6500000000000008e-07 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585428+0000", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.716e-06 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585439+0000", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1077000000000001e-05 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585446+0000", 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6880000000000002e-06 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585493+0000", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6782e-05 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585576+0000", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3336000000000003e-05 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585654+0000", 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7677999999999997e-05 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.590788+0000", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051340090000000001 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593555+0000", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027675479999999999 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593602+0000", 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6428999999999999e-05 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593635+0000", 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3756e-05 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3955 4.17 4:ebe7b1a9:::1000000119a.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.621199+0000", 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.72556362799999996, 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080048540000000005, 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.428 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3955 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621199+0000", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621199+0000", 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621200+0000", 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5000000000000002e-07 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621203+0000", 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5870000000000001e-06 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621214+0000", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0043e-05 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621219+0000", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7200000000000003e-06 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621258+0000", 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8999999999999999e-05 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.621331+0000", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3207000000000006e-05 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.629099+0000", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0077678900000000004 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.629139+0000", 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9369999999999997e-05 2024-06-11T16:00:36.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.629204+0000", 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5287e-05 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4234 4.2b 4:d6c0a2dd:::100000012b1.00000000:head [write 0~981] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.50190324900000005, 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080483589999999997, 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.433 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4234 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9100000000000004e-07 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844864+0000", 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9299999999999996e-06 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844871+0000", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8090000000000004e-06 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844875+0000", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844928+0000", 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2604e-05 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845036+0000", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107718 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845172+0000", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013625700000000001 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.849755+0000", 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045829690000000001 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852801+0000", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030463859999999999 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852868+0000", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6753000000000003e-05 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852908+0000", 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9814999999999997e-05 2024-06-11T16:00:36.438 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4235 4.3f 4:fe213bc7:::100000012b2.00000000:head [write 0~131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.50096047600000004, 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010193702000000001, 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4235 2024-06-11T16:00:36.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845803+0000", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0999999999999998e-07 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845808+0000", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7659999999999998e-06 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845834+0000", 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5741999999999998e-05 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845840+0000", 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8709999999999999e-06 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846874+0000", 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001033324 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846980+0000", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010641000000000001 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847095+0000", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114589 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852937+0000", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058427749999999997 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855921+0000", 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029836139999999999 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855960+0000", 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9354999999999998e-05 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855996+0000", 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5546000000000002e-05 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4236 4.27 4:e4ac751f:::100000012b3.00000000:head [write 0~981] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.50005237499999999, 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093773869999999992, 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4236 2024-06-11T16:00:36.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846711+0000", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846716+0000", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6809999999999997e-06 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846725+0000", 2024-06-11T16:00:36.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0159999999999997e-06 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846731+0000", 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3840000000000002e-06 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846907+0000", 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017598599999999999 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847018+0000", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111185 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847146+0000", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012720099999999999 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852901+0000", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057549660000000002 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856003+0000", 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031021709999999999 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856045+0000", 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2177e-05 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856088+0000", 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.286e-05 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4237 4.1c 4:3b868237:::100000012b4.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.49905669699999999, 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083006250000000007, 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4237 2024-06-11T16:00:36.451 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847707+0000", 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847710+0000", 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.461e-06 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847717+0000", 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847722+0000", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.22e-06 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847760+0000", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8463000000000001e-05 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847830+0000", 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0030999999999994e-05 2024-06-11T16:00:36.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847906+0000", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5222999999999995e-05 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852765+0000", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048596459999999996 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855929+0000", 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00316403 2024-06-11T16:00:36.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855971+0000", 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1783999999999998e-05 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856007+0000", 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5596999999999998e-05 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:133 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.133745325, 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011381766, 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:36.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213021+0000", 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0740000000000001e-06 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213130+0000", 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010991400000000001 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213166+0000", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5536e-05 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213183+0000", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7399999999999999e-05 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213275+0000", 2024-06-11T16:00:36.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1249999999999995e-05 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213373+0000", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8597000000000005e-05 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.218513+0000", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051394739999999998 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.221761+0000", 2024-06-11T16:00:36.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003248304 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224332+0000", 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025710199999999998 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224367+0000", 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5383999999999999e-05 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:36.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224399+0000", 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1813000000000002e-05 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:36.462 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:36.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:36.464 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.464+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-06-11T16:00:36.564 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.565+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.570 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:36.570 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:36.571 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:36.571 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:36.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:36.666 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.667+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.684 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:36.684 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:36.684 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:36.684 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:36.685 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:36.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:36.766 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.767+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:36.800 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:36.800 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:36.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:36.800 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602758991000002, 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066155069999999996, 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:36.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197679+0000", 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197691+0000", 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1759e-05 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197721+0000", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0301e-05 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197751+0000", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0111999999999999e-05 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197764+0000", 2024-06-11T16:00:36.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3157e-05 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197829+0000", 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4666999999999996e-05 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197926+0000", 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7176999999999995e-05 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000115835 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199792+0000", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001749897 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204211+0000", 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044193929999999998 2024-06-11T16:00:36.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204253+0000", 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1459999999999999e-05 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204294+0000", 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1749000000000003e-05 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602643721999996, 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010457917000000001, 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197794+0000", 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197795+0000", 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.85e-07 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197800+0000", 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1429999999999997e-06 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197810+0000", 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7659999999999993e-06 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197817+0000", 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5239999999999997e-06 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198324+0000", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00050712900000000004 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198412+0000", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8844999999999994e-05 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014927899999999999 2024-06-11T16:00:36.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200457+0000", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018955319999999999 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208190+0000", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077328650000000002 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208224+0000", 2024-06-11T16:00:36.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3757999999999998e-05 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208252+0000", 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8191000000000002e-05 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602611921000005, 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010409584, 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:36.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197826+0000", 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197827+0000", 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.13e-07 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197846+0000", 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9482000000000001e-05 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197854+0000", 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2679999999999994e-06 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197872+0000", 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7541999999999999e-05 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198318+0000", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044594799999999999 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198428+0000", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011006999999999999 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198562+0000", 2024-06-11T16:00:36.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000133948 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200463+0000", 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00190132 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208146+0000", 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0076828540000000002 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208193+0000", 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6641000000000003e-05 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208236+0000", 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2997999999999997e-05 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.818 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602555156999998, 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010704010999999999, 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197883+0000", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197884+0000", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3900000000000004e-07 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197888+0000", 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3660000000000002e-06 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197895+0000", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9290000000000001e-06 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197901+0000", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.913e-06 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198805+0000", 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00090411699999999996 2024-06-11T16:00:36.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198883+0000", 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7933000000000001e-05 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199011+0000", 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012775699999999999 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.822 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200583+0000", 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001572571 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208488+0000", 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079049399999999992 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208543+0000", 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5222000000000001e-05 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208587+0000", 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3424000000000003e-05 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602528655, 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062039690000000002, 2024-06-11T16:00:36.824 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197909+0000", 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197910+0000", 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.46e-07 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197913+0000", 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5710000000000002e-06 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197920+0000", 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4030000000000004e-06 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197925+0000", 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.989e-06 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197971+0000", 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6514999999999998e-05 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198086+0000", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114481 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198220+0000", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013438799999999999 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199625+0000", 2024-06-11T16:00:36.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001404577 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204011+0000", 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043858789999999996 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204063+0000", 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2868000000000003e-05 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204113+0000", 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9852000000000003e-05 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602499608000002, 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069427949999999999, 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.830 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197938+0000", 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197939+0000", 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197942+0000", 2024-06-11T16:00:36.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3720000000000001e-06 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197950+0000", 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1920000000000005e-06 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197974+0000", 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3096999999999999e-05 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198543+0000", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00056976499999999996 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198605+0000", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1414000000000005e-05 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198708+0000", 2024-06-11T16:00:36.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103497 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200479+0000", 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001770738 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204783+0000", 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043037040000000002 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204837+0000", 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4401999999999999e-05 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204881+0000", 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4024999999999999e-05 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.837 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602448550000005, 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010693615, 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197989+0000", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197990+0000", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2399999999999997e-07 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.197994+0000", 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7570000000000002e-06 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198001+0000", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3690000000000001e-06 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198028+0000", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6925000000000001e-05 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199818+0000", 2024-06-11T16:00:36.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017899490000000001 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.199909+0000", 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1388e-05 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.200050+0000", 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014093499999999999 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.201409+0000", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001358894 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208585+0000", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071756980000000003 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208628+0000", 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3407e-05 2024-06-11T16:00:36.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.208683+0000", 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4568999999999999e-05 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 97.602396916999993, 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067501949999999996, 2024-06-11T16:00:36.843 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198041+0000", 2024-06-11T16:00:36.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198042+0000", 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4099999999999998e-07 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198046+0000", 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1099999999999996e-06 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198053+0000", 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5070000000000003e-06 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198061+0000", 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3390000000000004e-06 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198121+0000", 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9988000000000002e-05 2024-06-11T16:00:36.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.198247+0000", 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012639199999999999 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T15:58:59.204791+0000", 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065442180000000001 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.847 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.6109762439999997, 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:36.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.6040184809999998, 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.852 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:36.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:36.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.856 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:32 4.2e e55/33 4:7611a124:::1000000021e.00000000:head v 55'2, mlcod=0'0)", 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5965085840000004, 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061699179999999999, 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203929+0000", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.203930+0000", 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-06-11T16:00:36.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205146+0000", 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012159899999999999 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205158+0000", 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2302e-05 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205166+0000", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5820000000000004e-06 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205216+0000", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0355999999999997e-05 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.205233+0000", 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7371e-05 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210073+0000", 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048391069999999996 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210099+0000", 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6669000000000002e-05 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.861 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3618 4.3c e56/43 4:3d3cb2dc:::10000001049.00000000:head v 56'40, mlcod=56'37)", 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.430982615, 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062099750000000004, 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369455+0000", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369462+0000", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5969999999999997e-06 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369472+0000", 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0343000000000001e-05 2024-06-11T16:00:36.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369497+0000", 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4661999999999999e-05 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369509+0000", 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.172e-05 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369633+0000", 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012426099999999999 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.369691+0000", 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7834999999999998e-05 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.375635+0000", 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059441989999999998 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.375665+0000", 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0358e-05 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3638 4.0 e56/43 4:026655a4:::1000000105d.00000000:head v 56'48, mlcod=56'46)", 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.4167419699999999, 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061692960000000003, 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.866 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383696+0000", 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383697+0000", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383703+0000", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.861e-06 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383713+0000", 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7000000000000003e-06 2024-06-11T16:00:36.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383718+0000", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8029999999999996e-06 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383761+0000", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2935000000000001e-05 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.383777+0000", 2024-06-11T16:00:36.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.666e-05 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.389809+0000", 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0060312869999999998 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.389865+0000", 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6483000000000001e-05 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3813 4.2a e56/43 4:56e14134:::1000000110c.00000000:head v 56'63, mlcod=56'61)", 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.28516276, 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066189489999999998, 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515275+0000", 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0699999999999998e-07 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515278+0000", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7410000000000001e-06 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515284+0000", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0390000000000001e-06 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515287+0000", 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1820000000000002e-06 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515317+0000", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9124000000000001e-05 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515327+0000", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.057e-05 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521854+0000", 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065272150000000003 2024-06-11T16:00:36.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521894+0000", 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9771000000000003e-05 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.14414.0:3814 4.1f 4:f81ce58e:::1000000110d.00000000:head [write 0~1270] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:36.875 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2846704309999999, 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062152459999999998, 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.14414", 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 3814 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515767+0000", 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515768+0000", 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.68e-07 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515771+0000", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.32e-06 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515779+0000", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9030000000000004e-06 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515783+0000", 2024-06-11T16:00:36.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0980000000000004e-06 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515817+0000", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3902999999999997e-05 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.515891+0000", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3782999999999995e-05 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521865+0000", 2024-06-11T16:00:36.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059738940000000004 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521897+0000", 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2401999999999999e-05 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.521983+0000", 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5274999999999999e-05 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.880 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3815 4.36 e56/33 4:6f41bf00:::1000000110e.00000000:head v 56'57, mlcod=56'55)", 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.28360147, 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0078896599999999997, 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516836+0000", 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516837+0000", 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.27e-07 2024-06-11T16:00:36.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516840+0000", 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2169999999999999e-06 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516848+0000", 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1130000000000001e-06 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516853+0000", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9490000000000004e-06 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516889+0000", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5540999999999997e-05 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.516900+0000", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1669e-05 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524693+0000", 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077925499999999997 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524726+0000", 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3194000000000001e-05 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3816 4.36 e56/33 4:6ebc5ac6:::1000000110f.00000000:head v 56'58, mlcod=56'55)", 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:36.885 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2829008609999999, 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0072148300000000002, 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517537+0000", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517538+0000", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8599999999999998e-07 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517552+0000", 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4517e-05 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517562+0000", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5780000000000005e-06 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517567+0000", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7720000000000002e-06 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517595+0000", 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8847e-05 2024-06-11T16:00:36.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.517606+0000", 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0185e-05 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524729+0000", 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0071232409999999998 2024-06-11T16:00:36.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524752+0000", 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3104000000000001e-05 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:3817 4.3c e56/43 4:3d01cf74:::10000001110.00000000:head v 56'46, mlcod=56'44)", 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.282233371, 2024-06-11T16:00:36.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065498600000000002, 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:36.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518205+0000", 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8500000000000002e-07 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518208+0000", 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1259999999999998e-06 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518215+0000", 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6989999999999997e-06 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518225+0000", 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0275000000000001e-05 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518262+0000", 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6782000000000001e-05 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.518273+0000", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1473e-05 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524729+0000", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0064555330000000003 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.524754+0000", 2024-06-11T16:00:36.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5587000000000001e-05 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:4101 4.2f e56/17 4:f60489f4:::1000000122c.00000000:head v 56'72, mlcod=56'70)", 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.0566831780000001, 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0074973160000000004, 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743755+0000", 2024-06-11T16:00:36.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743759+0000", 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7230000000000002e-06 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743768+0000", 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7860000000000002e-06 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743773+0000", 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3079999999999998e-06 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743812+0000", 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8722e-05 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.743825+0000", 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2683999999999999e-05 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751222+0000", 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00739728 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751252+0000", 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0246000000000001e-05 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.899 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:4102 4.25 e56/43 4:a5af3e67:::1000000122d.00000000:head v 56'54, mlcod=56'52)", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.0559515420000001, 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006826197, 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:36.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744486+0000", 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744487+0000", 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744493+0000", 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.314e-06 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744502+0000", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.456e-06 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744506+0000", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3290000000000004e-06 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744553+0000", 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7407999999999997e-05 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.744573+0000", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0094000000000001e-05 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751259+0000", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066857039999999998 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:35.751313+0000", 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3381999999999998e-05 2024-06-11T16:00:36.903 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:36.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:36.904 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:36.905 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:00:36.906 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:36.906 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:36.906+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:37.007+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:37.016 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:37.016 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:37.017 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:37.017 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:37.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:37.107 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.108+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.130 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:37.130 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:37.130 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:37.130 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:37.130 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:37.139 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:37.223 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.224+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.285 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 98.088963903000007, 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:37.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.291 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 98.088712314999995, 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 98.088373716999996, 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:37.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:37.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:37.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 98.088291455999993, 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:37.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:37.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.813804331, 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:37.309 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.10186838, 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:37.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:37.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.0966705220000001, 2024-06-11T16:00:37.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:37.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:37.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:37.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:32 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~1337428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:37.321 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.0836326710000002, 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082427049999999995, 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201991+0000", 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9250000000000002e-06 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203544+0000", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001552903 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203555+0000", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1316e-05 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203568+0000", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2955e-05 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203621+0000", 2024-06-11T16:00:37.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2667999999999998e-05 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203719+0000", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8268000000000002e-05 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203806+0000", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206690+0000", 2024-06-11T16:00:37.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028845720000000002 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210148+0000", 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034572639999999998 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210191+0000", 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3559000000000001e-05 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210232+0000", 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0674999999999999e-05 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3582 4.3a 4:5cd099ca:::10000001025.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9428548960000001, 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080868590000000001, 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.327 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3582 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342768+0000", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342772+0000", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7049999999999998e-06 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342780+0000", 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9459999999999998e-06 2024-06-11T16:00:37.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342785+0000", 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4379999999999997e-06 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342828+0000", 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3135e-05 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342946+0000", 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118181 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.343064+0000", 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118096 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.344810+0000", 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017457880000000001 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350771+0000", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059614230000000004 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350819+0000", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7706e-05 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350854+0000", 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4851000000000002e-05 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.332 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3770 4.19 4:982578ba:::100000010e1.00000000:head [write 0~1622] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.8034212300000001, 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0086915499999999993, 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.333 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3770 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2699999999999999e-07 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482205+0000", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9589999999999997e-06 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482213+0000", 2024-06-11T16:00:37.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000008e-06 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482217+0000", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1409999999999998e-06 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482251+0000", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3940999999999999e-05 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482318+0000", 2024-06-11T16:00:37.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7057000000000005e-05 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482393+0000", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5356000000000002e-05 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483398+0000", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001004944 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490809+0000", 2024-06-11T16:00:37.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074110900000000004 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490852+0000", 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2324999999999999e-05 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490892+0000", 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0410000000000001e-05 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3772 4.17 4:e8a95beb:::100000010e3.00000000:head [write 0~2546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.8018800109999999, 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082916239999999992, 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3772 2024-06-11T16:00:37.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483743+0000", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6400000000000001e-07 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483747+0000", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2540000000000003e-06 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483757+0000", 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0477e-05 2024-06-11T16:00:37.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483763+0000", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1850000000000003e-06 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483802+0000", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9239000000000002e-05 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483876+0000", 2024-06-11T16:00:37.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4433999999999999e-05 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491895+0000", 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080190130000000002 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491943+0000", 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7834000000000003e-05 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.492034+0000", 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0424e-05 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3815 4.36 4:6f41bf00:::1000000110e.00000000:head [write 0~117] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.7691310869999999, 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084138389999999993, 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.344 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3815 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516492+0000", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.61e-07 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516495+0000", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8139999999999998e-06 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516506+0000", 2024-06-11T16:00:37.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0669000000000001e-05 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516511+0000", 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3029999999999999e-06 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516556+0000", 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5138e-05 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516654+0000", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7398000000000005e-05 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516738+0000", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4473000000000003e-05 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.517649+0000", 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00091060100000000003 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524816+0000", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071670950000000001 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524865+0000", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8573999999999999e-05 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524905+0000", 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0012999999999998e-05 2024-06-11T16:00:37.349 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3908 4.c 4:30766283:::1000000116b.00000000:head [write 0~1951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.700200599, 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082139840000000006, 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.350 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3908 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585422+0000", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6500000000000008e-07 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585428+0000", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.716e-06 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585439+0000", 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1077000000000001e-05 2024-06-11T16:00:37.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585446+0000", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6880000000000002e-06 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585493+0000", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6782e-05 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585576+0000", 2024-06-11T16:00:37.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3336000000000003e-05 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585654+0000", 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7677999999999997e-05 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.590788+0000", 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051340090000000001 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593555+0000", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027675479999999999 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593602+0000", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6428999999999999e-05 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593635+0000", 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3756e-05 2024-06-11T16:00:37.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4234 4.2b 4:d6c0a2dd:::100000012b1.00000000:head [write 0~981] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.4407623520000001, 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080483589999999997, 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.356 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4234 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844860+0000", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9100000000000004e-07 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844864+0000", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9299999999999996e-06 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844871+0000", 2024-06-11T16:00:37.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8090000000000004e-06 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844875+0000", 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.844928+0000", 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2604e-05 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845036+0000", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107718 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845172+0000", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013625700000000001 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.849755+0000", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045829690000000001 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852801+0000", 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030463859999999999 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852868+0000", 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6753000000000003e-05 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852908+0000", 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9814999999999997e-05 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4235 4.3f 4:fe213bc7:::100000012b2.00000000:head [write 0~131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.4398195789999999, 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010193702000000001, 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.362 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4235 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845803+0000", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0999999999999998e-07 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845808+0000", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7659999999999998e-06 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845834+0000", 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5741999999999998e-05 2024-06-11T16:00:37.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845840+0000", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8709999999999999e-06 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846874+0000", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001033324 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846980+0000", 2024-06-11T16:00:37.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010641000000000001 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847095+0000", 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114589 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852937+0000", 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058427749999999997 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855921+0000", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029836139999999999 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855960+0000", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9354999999999998e-05 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855996+0000", 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5546000000000002e-05 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4236 4.27 4:e4ac751f:::100000012b3.00000000:head [write 0~981] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.4389114780000001, 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093773869999999992, 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4236 2024-06-11T16:00:37.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846711+0000", 2024-06-11T16:00:37.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846716+0000", 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6809999999999997e-06 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846725+0000", 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0159999999999997e-06 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846731+0000", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3840000000000002e-06 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846907+0000", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017598599999999999 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847018+0000", 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111185 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847146+0000", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012720099999999999 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852901+0000", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057549660000000002 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856003+0000", 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031021709999999999 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856045+0000", 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2177e-05 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856088+0000", 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.286e-05 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4237 4.1c 4:3b868237:::100000012b4.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-06-11T16:00:37.373 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.4379158000000001, 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083006250000000007, 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4237 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847707+0000", 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847710+0000", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.461e-06 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847717+0000", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847722+0000", 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.22e-06 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847760+0000", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8463000000000001e-05 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847830+0000", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0030999999999994e-05 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847906+0000", 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5222999999999995e-05 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852765+0000", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048596459999999996 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855929+0000", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00316403 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855971+0000", 2024-06-11T16:00:37.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1783999999999998e-05 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856007+0000", 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5596999999999998e-05 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:133 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.072604428, 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011381766, 2024-06-11T16:00:37.379 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213021+0000", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0740000000000001e-06 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213130+0000", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010991400000000001 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213166+0000", 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5536e-05 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213183+0000", 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7399999999999999e-05 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213275+0000", 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1249999999999995e-05 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213373+0000", 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8597000000000005e-05 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.218513+0000", 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051394739999999998 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.221761+0000", 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003248304 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224332+0000", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025710199999999998 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224367+0000", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5383999999999999e-05 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224399+0000", 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1813000000000002e-05 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.384 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:141 3.b 3:d5c7a900:::200.00000003:head [write 482512~3711792 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.441300266, 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018477917999999999, 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844325+0000", 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.976e-06 2024-06-11T16:00:37.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851409+0000", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070840349999999998 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851425+0000", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5931e-05 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851434+0000", 2024-06-11T16:00:37.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9449999999999999e-06 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851498+0000", 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4874000000000003e-05 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851569+0000", 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1101999999999998e-05 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851656+0000", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6076999999999996e-05 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.858822+0000", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071663270000000001 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862737+0000", 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039154970000000004 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862773+0000", 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5874999999999998e-05 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862800+0000", 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6279e-05 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.390 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:142 3.0 3:02ac1934:::200.00000009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.434165894, 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097524020000000003, 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851457+0000", 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851460+0000", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9490000000000001e-06 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851469+0000", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9190000000000005e-06 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851475+0000", 2024-06-11T16:00:37.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7830000000000004e-06 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851524+0000", 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9407000000000003e-05 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:37.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851602+0000", 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7787000000000006e-05 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.861208+0000", 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096066250000000006 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:37.395 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:37.397 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:37.397 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.398+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:37.497 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.499+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.517 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:37.517 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:37.517 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:37.517 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:37.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:37.547 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:37.547 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:37.566 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:37.567 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:37.567 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:37.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:37.570 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:37.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:37.599+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:37.633 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:37.633 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:37.642 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:37.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:37.729+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:37.798 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:37.798 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:37.800 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.801+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.807 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:37.901 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:37.902+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:37.922 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:37.922 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:37.931 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:38.015 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.016+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.086 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.086 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.096 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:38.137 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.138+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:38.204+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:38.255 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.255 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.264 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:38.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:38.309+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:38.378 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.379 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.389 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:38.405 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.406+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.506 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.507+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.548 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.548 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:38.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:38.607+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:38.672 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.672 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.681 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:38.725 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.726+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.796 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.796 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.806 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:38.849 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.848+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:00:38.909 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:38.910+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:38.961 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:38.961 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:38.970 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:39.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.010+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.111+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.123 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:39.123 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:39.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:39.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.212+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.244 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:39.244 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:39.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:39.314 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:39.314+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:39.413 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:39.414+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:39.419 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:39.419 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:39.428 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:39.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.514+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.540 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:39.540 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:39.550 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:39.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:39.615 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:39.615+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:39.671 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:39.706 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:39.707 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:39.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.716+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.731 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:39.734 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:39.735 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:39.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:39.817+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:39.826 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:39.826 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:39.826 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:39.826 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:39.826 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:39.836 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:39.859 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:00:39.917 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:39.918+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:39.954 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:39.954 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 100.757486439, 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088975389999999994, 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196658+0000", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196659+0000", 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3349999999999999e-06 2024-06-11T16:00:39.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196666+0000", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2060000000000004e-06 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196676+0000", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0854e-05 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196686+0000", 2024-06-11T16:00:39.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4259999999999992e-06 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.199927+0000", 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003241308 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200018+0000", 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0739e-05 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.200265+0000", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00024698199999999997 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204082+0000", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038170320000000002 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205490+0000", 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014077810000000001 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.959 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205529+0000", 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9709000000000002e-05 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205556+0000", 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6166999999999999e-05 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.960 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 100.75723485100001, 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097876890000000005, 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.961 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196910+0000", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2999999999999999e-07 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196916+0000", 2024-06-11T16:00:39.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.203e-06 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196925+0000", 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.037e-06 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.196932+0000", 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9670000000000004e-06 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201124+0000", 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0041927839999999997 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201324+0000", 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019995399999999999 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 2", 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.201499+0000", 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000174594 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.204618+0000", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031186109999999999 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206613+0000", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019950990000000002 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206656+0000", 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2945000000000003e-05 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.206697+0000", 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1665000000000002e-05 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 100.75689625299999, 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083737289999999999, 2024-06-11T16:00:39.966 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197248+0000", 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197249+0000", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9299999999999996e-07 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197254+0000", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197264+0000", 2024-06-11T16:00:39.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0114e-05 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197274+0000", 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0389e-05 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198627+0000", 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013522829999999999 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.198740+0000", 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113656 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.205622+0000", 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0068814840000000002 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-06-11T16:00:39.970 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 100.756813992, 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099969470000000008, 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197330+0000", 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197331+0000", 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4300000000000002e-07 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197335+0000", 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7100000000000001e-06 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197346+0000", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0967e-05 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.197354+0000", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8849999999999999e-06 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202174+0000", 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048205849999999996 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.202350+0000", 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017542799999999999 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T15:58:59.207327+0000", 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049776289999999999 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.4823268669999994, 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:39.975 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.7703909160000002, 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.980 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:39.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:39.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.7651930580000004, 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.986 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:39.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:39.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:39.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:39.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:39.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:32 4.2e 4:7611a124:::1000000021e.00000000:head [write 0~1337428] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.7521552070000004, 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082427049999999995, 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:39.995 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 32 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201989+0000", 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.201991+0000", 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9250000000000002e-06 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203544+0000", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001552903 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203555+0000", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1316e-05 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203568+0000", 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2955e-05 2024-06-11T16:00:39.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203621+0000", 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2667999999999998e-05 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203719+0000", 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8268000000000002e-05 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:39.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.203806+0000", 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6600000000000004e-05 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206690+0000", 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028845720000000002 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210148+0000", 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034572639999999998 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210191+0000", 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3559000000000001e-05 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210232+0000", 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0674999999999999e-05 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3582 4.3a 4:5cd099ca:::10000001025.00000000:head [write 0~1429] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.001 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.6113774320000003, 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080868590000000001, 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3582 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342767+0000", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342768+0000", 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342772+0000", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7049999999999998e-06 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342780+0000", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9459999999999998e-06 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342785+0000", 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4379999999999997e-06 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342828+0000", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3135e-05 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.342946+0000", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118181 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.343064+0000", 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118096 2024-06-11T16:00:40.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.344810+0000", 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0017457880000000001 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350771+0000", 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059614230000000004 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350819+0000", 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7706e-05 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.350854+0000", 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4851000000000002e-05 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3770 4.19 4:982578ba:::100000010e1.00000000:head [write 0~1622] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:40.007 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.4719437659999999, 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0086915499999999993, 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3770 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:40.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482201+0000", 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2699999999999999e-07 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482205+0000", 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9589999999999997e-06 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482213+0000", 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000008e-06 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482217+0000", 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1409999999999998e-06 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482251+0000", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3940999999999999e-05 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482318+0000", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7057000000000005e-05 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.482393+0000", 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5356000000000002e-05 2024-06-11T16:00:40.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483398+0000", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001004944 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490809+0000", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074110900000000004 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490852+0000", 2024-06-11T16:00:40.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2324999999999999e-05 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.490892+0000", 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0410000000000001e-05 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3772 4.17 4:e8a95beb:::100000010e3.00000000:head [write 0~2546] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.4704025469999999, 2024-06-11T16:00:40.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082916239999999992, 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3772 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483742+0000", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483743+0000", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6400000000000001e-07 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483747+0000", 2024-06-11T16:00:40.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2540000000000003e-06 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483757+0000", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0477e-05 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483763+0000", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1850000000000003e-06 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483802+0000", 2024-06-11T16:00:40.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9239000000000002e-05 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.483876+0000", 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4433999999999999e-05 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491895+0000", 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080190130000000002 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.491943+0000", 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7834000000000003e-05 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.492034+0000", 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0424e-05 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3815 4.36 4:6f41bf00:::1000000110e.00000000:head [write 0~117] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:40.018 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.4376536230000001, 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0084138389999999993, 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3815 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:40.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516491+0000", 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516492+0000", 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.61e-07 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516495+0000", 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8139999999999998e-06 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516506+0000", 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0669000000000001e-05 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516511+0000", 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3029999999999999e-06 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516556+0000", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5138e-05 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516654+0000", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7398000000000005e-05 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.516738+0000", 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4473000000000003e-05 2024-06-11T16:00:40.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.517649+0000", 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00091060100000000003 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524816+0000", 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071670950000000001 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524865+0000", 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8573999999999999e-05 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.524905+0000", 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0012999999999998e-05 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:3908 4.c 4:30766283:::1000000116b.00000000:head [write 0~1951] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3687231349999998, 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082139840000000006, 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 3908 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:40.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585421+0000", 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585422+0000", 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6500000000000008e-07 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585428+0000", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.716e-06 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585439+0000", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1077000000000001e-05 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585446+0000", 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6880000000000002e-06 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585493+0000", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6782e-05 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585576+0000", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3336000000000003e-05 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.585654+0000", 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7677999999999997e-05 2024-06-11T16:00:40.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.590788+0000", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051340090000000001 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593555+0000", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0027675479999999999 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593602+0000", 2024-06-11T16:00:40.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6428999999999999e-05 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.593635+0000", 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3756e-05 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4235 4.3f 4:fe213bc7:::100000012b2.00000000:head [write 0~131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:40.030 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1083421150000001, 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010193702000000001, 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4235 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:40.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845802+0000", 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845803+0000", 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0999999999999998e-07 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845808+0000", 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7659999999999998e-06 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845834+0000", 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5741999999999998e-05 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.845840+0000", 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8709999999999999e-06 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846874+0000", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001033324 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846980+0000", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010641000000000001 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847095+0000", 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000114589 2024-06-11T16:00:40.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852937+0000", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058427749999999997 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855921+0000", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029836139999999999 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855960+0000", 2024-06-11T16:00:40.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9354999999999998e-05 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855996+0000", 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5546000000000002e-05 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4236 4.27 4:e4ac751f:::100000012b3.00000000:head [write 0~981] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1074340139999999, 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093773869999999992, 2024-06-11T16:00:40.036 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4236 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846710+0000", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846711+0000", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6000000000000003e-07 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846716+0000", 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6809999999999997e-06 2024-06-11T16:00:40.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846725+0000", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0159999999999997e-06 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846731+0000", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3840000000000002e-06 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.846907+0000", 2024-06-11T16:00:40.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017598599999999999 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847018+0000", 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111185 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847146+0000", 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012720099999999999 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852901+0000", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057549660000000002 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856003+0000", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031021709999999999 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856045+0000", 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2177e-05 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856088+0000", 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.286e-05 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:4237 4.1c 4:3b868237:::100000012b4.00000000:head [write 0~140] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1064383360000001, 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083006250000000007, 2024-06-11T16:00:40.042 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 4237 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847706+0000", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847707+0000", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847710+0000", 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.461e-06 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847717+0000", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847722+0000", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.22e-06 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847760+0000", 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8463000000000001e-05 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847830+0000", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0030999999999994e-05 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.847906+0000", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5222999999999995e-05 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.852765+0000", 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048596459999999996 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855929+0000", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00316403 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.855971+0000", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1783999999999998e-05 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:35.856007+0000", 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5596999999999998e-05 2024-06-11T16:00:40.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:133 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.7411269640000002, 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011381766, 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213017+0000", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213021+0000", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0740000000000001e-06 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213130+0000", 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010991400000000001 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213166+0000", 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5536e-05 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213183+0000", 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7399999999999999e-05 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213275+0000", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1249999999999995e-05 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.213373+0000", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8597000000000005e-05 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.218513+0000", 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051394739999999998 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.221761+0000", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003248304 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224332+0000", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025710199999999998 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224367+0000", 2024-06-11T16:00:40.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5383999999999999e-05 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.224399+0000", 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1813000000000002e-05 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:141 3.b 3:d5c7a900:::200.00000003:head [write 482512~3711792 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.1098228020000001, 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018477917999999999, 2024-06-11T16:00:40.053 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:40.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844325+0000", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.976e-06 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851409+0000", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070840349999999998 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851425+0000", 2024-06-11T16:00:40.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5931e-05 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851434+0000", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9449999999999999e-06 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851498+0000", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4874000000000003e-05 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851569+0000", 2024-06-11T16:00:40.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1101999999999998e-05 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851656+0000", 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6076999999999996e-05 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.858822+0000", 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071663270000000001 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862737+0000", 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039154970000000004 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862773+0000", 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5874999999999998e-05 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862800+0000", 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6279e-05 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.058 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:142 3.0 3:02ac1934:::200.00000009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.1026884300000002, 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097524020000000003, 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851456+0000", 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851457+0000", 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851460+0000", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9490000000000001e-06 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851469+0000", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9190000000000005e-06 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851475+0000", 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7830000000000004e-06 2024-06-11T16:00:40.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851524+0000", 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9407000000000003e-05 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851602+0000", 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7787000000000006e-05 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.861208+0000", 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096066250000000006 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:146 3.1f 3:f83d65d8:::200.00000004:head [write 2289608~1904696 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:37.468792+0000", 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 2.485352062, 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0082259970000000005, 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:40.063 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.468792+0000", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.468792+0000", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:40.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.468793+0000", 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4099999999999997e-07 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471253+0000", 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0024593480000000001 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471264+0000", 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1445e-05 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471272+0000", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.525e-06 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471347+0000", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5823999999999998e-05 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471406+0000", 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8727000000000002e-05 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.471484+0000", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8052000000000004e-05 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.475010+0000", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035260180000000001 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.476961+0000", 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001950724 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.476994+0000", 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2863e-05 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:37.477018+0000", 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4530000000000001e-05 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:40.068 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-06-11T16:00:40.070 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-06-11T16:00:40.071 INFO:tasks.workunit.client.0.smithi089.stderr:+ make -j4 2024-06-11T16:00:40.072 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize -cfi 2024-06-11T16:00:40.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:40.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.070+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.172+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.179 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:40.179 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:40.179 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:40.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:40.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.274+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.360 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:40.360 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:40.360 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:40.360 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:40.360 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:40.369 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:40.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.411+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.421 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: putting auxiliary files in '.'. 2024-06-11T16:00:40.421 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file './config.guess' 2024-06-11T16:00:40.434 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file './config.sub' 2024-06-11T16:00:40.440 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file './install-sh' 2024-06-11T16:00:40.447 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file './ltmain.sh' 2024-06-11T16:00:40.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.474+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.475 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-06-11T16:00:40.475 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-06-11T16:00:40.482 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-06-11T16:00:40.489 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-06-11T16:00:40.495 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-06-11T16:00:40.502 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-06-11T16:00:40.509 INFO:tasks.workunit.client.0.smithi089.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-06-11T16:00:40.511 INFO:tasks.workunit.client.0.smithi089.stdout:cp include/install-sh . 2024-06-11T16:00:40.517 INFO:tasks.workunit.client.0.smithi089.stdout:aclocal -I m4 2024-06-11T16:00:40.518 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:40.518 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:40.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:40.518 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:40.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.3287445760000001, 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:40.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.3217868129999992, 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:40.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.527 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.251231276, 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:40.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:40.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25118509300000003, 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:40.532 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:40.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:40.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25116686799999999, 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:40.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25113395199999999, 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.541 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:40.545 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25111191599999999, 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:40.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25100242699999997, 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.550 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:40.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25095424999999999, 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25075682100000002, 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.559 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:40.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25072546499999998, 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:40.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:40.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25069855200000002, 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:40.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.250565274, 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25053629100000002, 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.577 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:40.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25049886700000001, 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.585 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.25003715700000001, 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:40.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:40.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.24929594699999999, 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:40.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:40.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:40.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:40.594 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.24925103900000001, 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:40.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.248850344, 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.599 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:40.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.603 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.24872338799999999, 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:40.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:40.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:40.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:40.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:40.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.610 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:40.611 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:40.611 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:40.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.613+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.612 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:40.713 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:40.714+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:40.717 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:40.717 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:40.717 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:40.717 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:40.726 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:40.813 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:40.814+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:40.871 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:40.871 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:40.871 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:40.871 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:40.871 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:40.879 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:40.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:40.915+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:40.973 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:40.973 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:40.973 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-06-11T16:00:40.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-06-11T16:00:41.014 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.015+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.025 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:41.025 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:41.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:29 4.30 4:0c00cb85:::1000000021d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 9.5530161830000004, 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017556026999999998, 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 29 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471818+0000", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.471819+0000", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8449999999999999e-06 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478945+0000", 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071257179999999996 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478963+0000", 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7812000000000002e-05 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.478972+0000", 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4739999999999994e-06 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479085+0000", 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112117 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.479245+0000", 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016083300000000001 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489271+0000", 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010025325 2024-06-11T16:00:41.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489305+0000", 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4557999999999997e-05 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:31.489374+0000", 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8344999999999997e-05 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:30 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3671083] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.8410802319999995, 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018909163, 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:41.032 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 30 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183754+0000", 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.183756+0000", 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4399999999999999e-06 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188910+0000", 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00515424 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188925+0000", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4904e-05 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188934+0000", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7390000000000005e-06 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189010+0000", 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6543000000000002e-05 2024-06-11T16:00:41.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189114+0000", 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103451 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.189204+0000", 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0172000000000003e-05 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.199055+0000", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098514750000000002 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202558+0000", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035023290000000002 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202614+0000", 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6100999999999997e-05 2024-06-11T16:00:41.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.202663+0000", 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8769e-05 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:31 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:41.038 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.8358823740000005, 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021248065, 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 31 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:41.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188951+0000", 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.188952+0000", 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6100000000000002e-07 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.195994+0000", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070422740000000003 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196008+0000", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3998999999999999e-05 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196016+0000", 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3019999999999995e-06 2024-06-11T16:00:41.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196072+0000", 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6118e-05 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196169+0000", 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6786999999999993e-05 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.196252+0000", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3110999999999998e-05 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.206587+0000", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010335087999999999 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210116+0000", 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003528921 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210162+0000", 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5788000000000003e-05 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:32.210199+0000", 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7316e-05 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.044 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:141 3.b 3:d5c7a900:::200.00000003:head [write 482512~3711792 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.1805121180000002, 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018477917999999999, 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844322+0000", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.844325+0000", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.976e-06 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851409+0000", 2024-06-11T16:00:41.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0070840349999999998 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851425+0000", 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5931e-05 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851434+0000", 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9449999999999999e-06 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.047 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851498+0000", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4874000000000003e-05 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851569+0000", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1101999999999998e-05 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.851656+0000", 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6076999999999996e-05 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.858822+0000", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0071663270000000001 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862737+0000", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0039154970000000004 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862773+0000", 2024-06-11T16:00:41.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5874999999999998e-05 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:36.862800+0000", 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6279e-05 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1031 4.2e 4:7427c9c1:::100000003b9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.050 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266221+0000", 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75861234399999999, 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014382864, 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266221+0000", 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266221+0000", 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266222+0000", 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8099999999999998e-07 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266224+0000", 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.897e-06 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266229+0000", 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8100000000000003e-06 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266235+0000", 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0540000000000002e-06 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266625+0000", 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039035699999999998 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266729+0000", 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010457 2024-06-11T16:00:41.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266812+0000", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2527000000000005e-05 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269870+0000", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0030580130000000001 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280553+0000", 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010682842 2024-06-11T16:00:41.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280584+0000", 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.133e-05 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280604+0000", 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0083000000000001e-05 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1034 4.29 4:96aa9846:::100000003bf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266357+0000", 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75847634500000005, 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0148536, 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266357+0000", 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266357+0000", 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266358+0000", 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2399999999999999e-07 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266360+0000", 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1619999999999998e-06 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266364+0000", 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4939999999999997e-06 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266367+0000", 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.96e-06 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266407+0000", 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9959999999999997e-05 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266505+0000", 2024-06-11T16:00:41.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7713000000000004e-05 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266592+0000", 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6429999999999997e-05 2024-06-11T16:00:41.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269741+0000", 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0031498749999999999 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281122+0000", 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011380751999999999 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281168+0000", 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5354e-05 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281211+0000", 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3476000000000002e-05 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.063 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1036 4.1d 4:bb2af69d:::100000003c3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266398+0000", 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75843598499999998, 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014249395, 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266398+0000", 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266398+0000", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266398+0000", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.65e-07 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266400+0000", 2024-06-11T16:00:41.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9410000000000001e-06 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266406+0000", 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0780000000000001e-06 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266411+0000", 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9849999999999997e-06 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266452+0000", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1094000000000003e-05 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266557+0000", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000104504 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266648+0000", 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0810999999999995e-05 2024-06-11T16:00:41.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269912+0000", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032648310000000002 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280574+0000", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010661397 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280612+0000", 2024-06-11T16:00:41.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7833000000000002e-05 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.280647+0000", 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5556000000000003e-05 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1043 4.31 4:8ca9c0f7:::100000003cf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266858+0000", 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75797599999999998, 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014325862, 2024-06-11T16:00:41.069 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266858+0000", 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266858+0000", 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266858+0000", 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3000000000000001e-07 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266860+0000", 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9609999999999999e-06 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266866+0000", 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0510000000000002e-06 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266871+0000", 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.498e-06 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266912+0000", 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1050999999999997e-05 2024-06-11T16:00:41.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267003+0000", 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0841000000000007e-05 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267081+0000", 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8533000000000002e-05 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269930+0000", 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0028493889999999999 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281103+0000", 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011172787999999999 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281153+0000", 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0018999999999997e-05 2024-06-11T16:00:41.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281184+0000", 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0301e-05 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1045 4.39 4:9de7aaaf:::100000003d9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266906+0000", 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.757927617, 2024-06-11T16:00:41.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014384950000000001, 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266906+0000", 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266906+0000", 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266907+0000", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.68e-07 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266909+0000", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.198e-06 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266916+0000", 2024-06-11T16:00:41.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.759e-06 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266921+0000", 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6969999999999998e-06 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266969+0000", 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7284999999999999e-05 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113028 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267178+0000", 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6484999999999995e-05 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269935+0000", 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002757261 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281216+0000", 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011280969 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281260+0000", 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3837000000000001e-05 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281291+0000", 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0862999999999999e-05 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1046 4.29 4:94bd1b8e:::100000003db.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266929+0000", 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75790453199999996, 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015314123000000001, 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.081 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266929+0000", 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266929+0000", 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266930+0000", 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9999999999999998e-07 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266932+0000", 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.88e-06 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266937+0000", 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.75e-06 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266940+0000", 2024-06-11T16:00:41.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9440000000000001e-06 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267330+0000", 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038976100000000002 2024-06-11T16:00:41.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267407+0000", 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7080000000000001e-05 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267494+0000", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7113000000000004e-05 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269940+0000", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002445919 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.282172+0000", 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012231680999999999 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.282206+0000", 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3924999999999998e-05 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.282243+0000", 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7570000000000001e-05 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.088 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1047 4.23 4:c48a077b:::100000003dd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.266952+0000", 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75788173700000006, 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014448371999999999, 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266952+0000", 2024-06-11T16:00:41.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266952+0000", 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266952+0000", 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5800000000000001e-07 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266955+0000", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.616e-06 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266959+0000", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8299999999999998e-06 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266962+0000", 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8820000000000001e-06 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.266999+0000", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7110999999999998e-05 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267075+0000", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6425000000000001e-05 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267146+0000", 2024-06-11T16:00:41.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0632999999999999e-05 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270054+0000", 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0029079090000000002 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281351+0000", 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011297052 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281376+0000", 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5099000000000001e-05 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.281400+0000", 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4556999999999999e-05 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.094 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1048 4.2d 4:b51477c9:::100000003df.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.267330+0000", 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75750361700000002, 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021031145000000001, 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267330+0000", 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267330+0000", 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267331+0000", 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0699999999999997e-07 2024-06-11T16:00:41.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267334+0000", 2024-06-11T16:00:41.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1319999999999998e-06 2024-06-11T16:00:41.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267340+0000", 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5069999999999997e-06 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267345+0000", 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7639999999999996e-06 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267385+0000", 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0008e-05 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267457+0000", 2024-06-11T16:00:41.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1495999999999994e-05 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267506+0000", 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9811999999999997e-05 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270019+0000", 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025130019999999999 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288133+0000", 2024-06-11T16:00:41.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018113377 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288329+0000", 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000195744 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288361+0000", 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2696e-05 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.104 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1050 4.1b 4:da1207b9:::100000003e3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.267835+0000", 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75699903899999998, 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.020837705000000002, 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267835+0000", 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267835+0000", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267835+0000", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4999999999999998e-07 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267837+0000", 2024-06-11T16:00:41.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.176e-06 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267844+0000", 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4069999999999998e-06 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267864+0000", 2024-06-11T16:00:41.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0602e-05 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267900+0000", 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5898000000000001e-05 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.267965+0000", 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5016000000000002e-05 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268015+0000", 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9416000000000003e-05 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270058+0000", 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020437960000000001 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288084+0000", 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018025903999999999 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288153+0000", 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8238999999999995e-05 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288672+0000", 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051980099999999997 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1051 4.7 4:e3b32bf4:::100000003e5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.268425+0000", 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75640922600000005, 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016202057999999998, 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.111 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268425+0000", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268425+0000", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268425+0000", 2024-06-11T16:00:41.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1800000000000001e-07 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268427+0000", 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8980000000000001e-06 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268433+0000", 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4479999999999999e-06 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268437+0000", 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1819999999999999e-06 2024-06-11T16:00:41.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268480+0000", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2463999999999999e-05 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268591+0000", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110876 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268689+0000", 2024-06-11T16:00:41.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8208999999999994e-05 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.272248+0000", 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0035593560000000001 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284542+0000", 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012293571999999999 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284587+0000", 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4808999999999997e-05 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284627+0000", 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9826000000000001e-05 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1052 4.2f 4:f739814c:::100000003e7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.117 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.268607+0000", 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75622712999999997, 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016143063999999999, 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268607+0000", 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268607+0000", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268607+0000", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7599999999999998e-07 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268609+0000", 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.773e-06 2024-06-11T16:00:41.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268613+0000", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3170000000000003e-06 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268616+0000", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9349999999999999e-06 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268646+0000", 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0577999999999998e-05 2024-06-11T16:00:41.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268754+0000", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010731 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.268848+0000", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4606999999999997e-05 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.272258+0000", 2024-06-11T16:00:41.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034097910000000001 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284681+0000", 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012422793 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284728+0000", 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6699999999999997e-05 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284750+0000", 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1984000000000002e-05 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1058 4.3f 4:fd3a1456:::100000003f3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.269057+0000", 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75577683900000003, 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019182214999999999, 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.123 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269057+0000", 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269057+0000", 2024-06-11T16:00:41.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269057+0000", 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8099999999999998e-07 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269060+0000", 2024-06-11T16:00:41.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.174e-06 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269067+0000", 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3770000000000001e-06 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269072+0000", 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.904e-06 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269113+0000", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0961999999999998e-05 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269248+0000", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013529699999999999 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269337+0000", 2024-06-11T16:00:41.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8599999999999999e-05 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.272291+0000", 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002954581 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288156+0000", 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015865291 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288203+0000", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6316999999999997e-05 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.288239+0000", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6331000000000002e-05 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1060 4.b 4:d18d1dc7:::100000003f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.269236+0000", 2024-06-11T16:00:41.129 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75559790599999999, 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015389918000000001, 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269236+0000", 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269236+0000", 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269237+0000", 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0100000000000004e-07 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269240+0000", 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.281e-06 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269247+0000", 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4510000000000003e-06 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269254+0000", 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9820000000000002e-06 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269363+0000", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010924100000000001 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269847+0000", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048321099999999999 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269933+0000", 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6518000000000001e-05 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.275032+0000", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0050991719999999999 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284556+0000", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0095236269999999998 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284585+0000", 2024-06-11T16:00:41.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9156e-05 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284626+0000", 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0577999999999997e-05 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1063 4.1c 4:3a12bc61:::100000003fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.269324+0000", 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75550943500000001, 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015366817, 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269324+0000", 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269324+0000", 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269325+0000", 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2e-07 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269327+0000", 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7969999999999999e-06 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269332+0000", 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8320000000000002e-06 2024-06-11T16:00:41.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269338+0000", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4269999999999999e-06 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269490+0000", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00015242899999999999 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269587+0000", 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6636000000000001e-05 2024-06-11T16:00:41.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.269670+0000", 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2831999999999996e-05 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.275017+0000", 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0053472659999999998 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284598+0000", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0095809680000000005 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284650+0000", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1785e-05 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284691+0000", 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1424999999999997e-05 2024-06-11T16:00:41.141 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1065 4.13 4:c895bc6d:::100000003ff.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.270260+0000", 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75457339800000001, 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014519262, 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.142 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270260+0000", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270260+0000", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270261+0000", 2024-06-11T16:00:41.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2500000000000005e-07 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270265+0000", 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0149999999999997e-06 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270274+0000", 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7730000000000005e-06 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270279+0000", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7779999999999998e-06 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270312+0000", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3144e-05 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270376+0000", 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3882999999999998e-05 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270434+0000", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8233999999999998e-05 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.275037+0000", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.004603546 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284707+0000", 2024-06-11T16:00:41.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096700950000000001 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284748+0000", 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0364999999999997e-05 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284780+0000", 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1804000000000002e-05 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1066 4.19 4:9a7502c6:::10000000401.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:40.270289+0000", 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.75454432199999999, 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014461712, 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270289+0000", 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270289+0000", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270290+0000", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6399999999999998e-07 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270291+0000", 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5120000000000001e-06 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270296+0000", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3510000000000004e-06 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270299+0000", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9390000000000002e-06 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270338+0000", 2024-06-11T16:00:41.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9387000000000001e-05 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270418+0000", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9709999999999994e-05 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.270470+0000", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2259999999999998e-05 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.275053+0000", 2024-06-11T16:00:41.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0045834329999999996 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284701+0000", 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096478109999999992 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284733+0000", 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1497e-05 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:41.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:40.284751+0000", 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8448e-05 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:41.153 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:41.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:41.155 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.155+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.255 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.256+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.270 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:41.270 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:41.270 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:41.270 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:41.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "epoch": 59, 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "fsid": "48aab8a4-b456-497c-bad9-c7e7b823c20e", 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "created": "2024-06-11T15:58:39.314448+0000", 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "modified": "2024-06-11T16:00:39.849396+0000", 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "last_up_change": "2024-06-11T15:59:55.393491+0000", 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "last_in_change": "2024-06-11T15:58:40.157171+0000", 2024-06-11T16:00:41.310 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_num": 5799936, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_set": [ 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "pglog_hardlimit", 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "purged_snapdirs", 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_deletes", 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "sortbitwise" 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_version": 4, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "full_ratio": 0.94999998807907104, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "nearfull_ratio": 0.85000002384185791, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_snapshot": "", 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_max": 4, 2024-06-11T16:00:41.311 INFO:teuthology.orchestra.run.smithi089.stdout: "max_osd": 3, 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "require_min_compat_client": "luminous", 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "min_compat_client": "jewel", 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "require_osd_release": "squid", 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "allow_crimson": false, 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "pools": [ 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 1, 2024-06-11T16:00:41.312 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": ".mgr", 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:49.605826+0000", 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:41.313 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 1, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 1, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 1, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 1, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 1, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.314 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "13", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:41.315 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:41.316 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_max": 32, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 1 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": {} 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 1 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:41.318 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 2, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "rbd", 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:54.347804+0000", 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:41.319 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 8, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 8, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 8, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 8, 2024-06-11T16:00:41.320 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 8, 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "16", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:41.321 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:41.322 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:41.323 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:41.324 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "options": {}, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "rbd": {} 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 2 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.325 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 3, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_metadata", 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.116550+0000", 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:41.326 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 32, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 32, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 32, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 32, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 32, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:41.327 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "18", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:41.328 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:41.330 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_bias": 4, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 16, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "recovery_priority": 5 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": "cephfs" 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.331 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 3 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "pool": 4, 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_name": "cephfs_data", 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "create_time": "2024-06-11T15:58:57.479861+0000", 2024-06-11T16:00:41.332 INFO:teuthology.orchestra.run.smithi089.stdout: "flags": 1, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "flags_names": "hashpspool", 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "type": 1, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "size": 2, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "min_size": 1, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_rule": 0, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_count": 0, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_target": 0, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_barrier": 0, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "object_hash": 2, 2024-06-11T16:00:41.333 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_autoscale_mode": "off", 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num": 64, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num": 64, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_placement_num_target": 64, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_target": 64, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_pending": 64, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "last_pg_merge_meta": { 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "source_pgid": "0.0", 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "ready_epoch": 0, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_started": 0, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "last_epoch_clean": 0, 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "source_version": "0'0", 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: "target_version": "0'0" 2024-06-11T16:00:41.334 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "last_change": "19", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend": "0", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_prenautilus": "0", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "last_force_op_resend_preluminous": "0", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "auid": 0, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_mode": "selfmanaged", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_seq": 0, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "snap_epoch": 0, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "pool_snaps": [], 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps": "[]", 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_bytes": 0, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "quota_max_objects": 0, 2024-06-11T16:00:41.335 INFO:teuthology.orchestra.run.smithi089.stdout: "tiers": [], 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "tier_of": -1, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "read_tier": -1, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "write_tier": -1, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_mode": "none", 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_bytes": 0, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "target_max_objects": 0, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_target_full_ratio_micro": 800000, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_flush_age": 0, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "cache_min_evict_age": 0, 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profile": "", 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_params": { 2024-06-11T16:00:41.336 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "none" 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_period": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_count": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "use_gmt_hitset": true, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "min_read_recency_for_promote": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "min_write_recency_for_promote": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_grade_decay_rate": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "hit_set_search_last_n": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "grade_table": [], 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "stripe_width": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "expected_num_objects": 0, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "fast_read": false, 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "options": { 2024-06-11T16:00:41.337 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_num_min": 64, 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "target_size_ratio": 0.89999997615814209 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "application_metadata": { 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "cephfs": { 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "data": "cephfs" 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "read_balance": { 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "error_message": "pool 4 average primary affinity is lower than 0.50, read balance score is not reliable", 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "score_acting": 0, 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: "score_stable": 0 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.338 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "osds": [ 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "ef58ea1e-862f-4fd9-b48e-87a3ca753c8c", 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 1, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 46, 2024-06-11T16:00:41.339 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6800", 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.340 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6801", 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.341 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6802", 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6803", 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.342 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6806", 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6807", 2024-06-11T16:00:41.343 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6804", 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.344 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.129:6805", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4055503049 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.129:6801/4055503049", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.129:6803/4055503049", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.129:6807/4055503049", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.129:6805/4055503049", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.345 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "28556a85-d5a7-40a9-89e8-3a45e8eaaa35", 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 1, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 1, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 45, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 0, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:41.346 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6800", 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6801", 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.347 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6802", 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6803", 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.348 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6806", 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6807", 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.349 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6804", 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.163:6805", 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 4023662438 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.350 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.163:6801/4023662438", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.163:6803/4023662438", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.163:6807/4023662438", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.163:6805/4023662438", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "exists", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "up" 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "uuid": "95d745de-187c-44a3-a4b1-a203f06a1cc8", 2024-06-11T16:00:41.351 INFO:teuthology.orchestra.run.smithi089.stdout: "up": 0, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "in": 1, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "weight": 0.233062744140625, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_affinity": 0.202545166015625, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_begin": 0, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "last_clean_end": 0, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "up_from": 8, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "up_thru": 33, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "down_at": 38, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "lost_at": 0, 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addrs": { 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.352 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6800", 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6801", 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addrs": { 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.353 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6802", 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6803", 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addrs": { 2024-06-11T16:00:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6806", 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6807", 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addrs": { 2024-06-11T16:00:41.355 INFO:teuthology.orchestra.run.smithi089.stdout: "addrvec": [ 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v2", 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6804", 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "172.21.15.171:6805", 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 443308706 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "public_addr": "172.21.15.171:6801/443308706", 2024-06-11T16:00:41.356 INFO:teuthology.orchestra.run.smithi089.stdout: "cluster_addr": "172.21.15.171:6803/443308706", 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_back_addr": "172.21.15.171:6807/443308706", 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "heartbeat_front_addr": "172.21.15.171:6805/443308706", 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "state": [ 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "exists" 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_xinfo": [ 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 0, 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:41.357 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.208604+0000", 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 1, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.254062+0000", 2024-06-11T16:00:41.358 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 0 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: { 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": 2, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "down_stamp": "0.000000", 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_probability": 0, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "laggy_interval": 0, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "features": 4540701547738038271, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "old_weight": 0, 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "last_purged_snaps_scrub": "2024-06-11T15:58:45.183321+0000", 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "dead_epoch": 37 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap": [], 2024-06-11T16:00:41.359 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_items": [], 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_upmap_primaries": [], 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "pg_temp": [], 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "primary_temp": [], 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklist": {}, 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "range_blocklist": {}, 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "erasure_code_profiles": { 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "default": { 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "crush-failure-domain": "osd", 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "k": "2", 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "m": "1", 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "plugin": "jerasure", 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: "technique": "reed_sol_van" 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.360 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "removed_snaps_queue": [], 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "new_removed_snaps": [], 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "new_purged_snaps": [], 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "crush_node_flags": {}, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "device_class_flags": {}, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode": { 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_enabled": false, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_bucket_count": 0, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "degraded_stretch_mode": 0, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "recovering_stretch_mode": 0, 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: "stretch_mode_bucket": 0 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-06-11T16:00:41.361 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:00:41.363 INFO:tasks.thrashosds.thrasher:j is {'epoch': 59, 'fsid': '48aab8a4-b456-497c-bad9-c7e7b823c20e', 'created': '2024-06-11T15:58:39.314448+0000', 'modified': '2024-06-11T16:00:39.849396+0000', 'last_up_change': '2024-06-11T15:59:55.393491+0000', 'last_in_change': '2024-06-11T15:58:40.157171+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-11T15:58:49.605826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-06-11T15:58:54.347804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-11T15:58:57.116550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 3 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-06-11T15:58:57.479861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 4 average primary affinity is lower than 0.50, read balance score is not reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': 'ef58ea1e-862f-4fd9-b48e-87a3ca753c8c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6800', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6801', 'nonce': 4055503049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6802', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6803', 'nonce': 4055503049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6806', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6807', 'nonce': 4055503049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6804', 'nonce': 4055503049}, {'type': 'v1', 'addr': '172.21.15.129:6805', 'nonce': 4055503049}]}, 'public_addr': '172.21.15.129:6801/4055503049', 'cluster_addr': '172.21.15.129:6803/4055503049', 'heartbeat_back_addr': '172.21.15.129:6807/4055503049', 'heartbeat_front_addr': '172.21.15.129:6805/4055503049', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '28556a85-d5a7-40a9-89e8-3a45e8eaaa35', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 4023662438}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 4023662438}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 4023662438}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 4023662438}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 4023662438}]}, 'public_addr': '172.21.15.163:6801/4023662438', 'cluster_addr': '172.21.15.163:6803/4023662438', 'heartbeat_back_addr': '172.21.15.163:6807/4023662438', 'heartbeat_front_addr': '172.21.15.163:6805/4023662438', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '95d745de-187c-44a3-a4b1-a203f06a1cc8', 'up': 0, 'in': 1, 'weight': 0.233062744140625, 'primary_affinity': 0.202545166015625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 38, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6800', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6801', 'nonce': 443308706}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6802', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6803', 'nonce': 443308706}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6806', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6807', 'nonce': 443308706}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6804', 'nonce': 443308706}, {'type': 'v1', 'addr': '172.21.15.171:6805', 'nonce': 443308706}]}, 'public_addr': '172.21.15.171:6801/443308706', 'cluster_addr': '172.21.15.171:6803/443308706', 'heartbeat_back_addr': '172.21.15.171:6807/443308706', 'heartbeat_front_addr': '172.21.15.171:6805/443308706', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.208604+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.254062+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-06-11T15:58:45.183321+0000', 'dead_epoch': 37}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-06-11T16:00:41.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:00:41.364 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.363+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.405 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:41.406 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:41.406 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:41.406 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:41.406 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:41.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:41.464 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.464+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.3413407179999997, 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:41.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:41.535 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.3343829550000006, 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:41.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:41.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263827418, 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:41.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:41.544 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2637812349999999, 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:41.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2637630099999999, 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:41.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:41.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263730094, 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:41.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263708058, 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.558 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:41.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:41.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.562 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263598569, 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:41.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263550392, 2024-06-11T16:00:41.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.571 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263352963, 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:41.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:41.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:41.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263321607, 2024-06-11T16:00:41.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.580 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2632946940000001, 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:41.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:41.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263161416, 2024-06-11T16:00:41.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:41.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.263132433, 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:41.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:41.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2630950089999999, 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.262633299, 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:41.599 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:41.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2618920890000001, 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:41.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.261847181, 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:41.608 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:41.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:41.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.2614464860000001, 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:41.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 1.26131953, 2024-06-11T16:00:41.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:41.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:41.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:41.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:41.622 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:41.624 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:41.624 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.624+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.663 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:00:41.665 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:00:41.675 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-06-11T16:00:41.596727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43087075,"num_objects":4716,"num_object_clones":0,"num_object_copies":9432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":801,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4716,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":5054,"num_write_kb":48109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":591020,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5002,"ondisk_log_size":5002,"up":191,"acting":191,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":150348,"kb_used_data":65128,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":282965172,"statfs":{"total":289910292480,"available":289756336128,"internally_reserved":0,"allocated":66691072,"data_stored":72829471,"data_compressed":6582518,"data_compressed_allocated":7929856,"data_compressed_original":38379520,"omap_allocated":4784,"internal_metadata":87223632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24758555,"num_objects":3788,"num_object_clones":0,"num_object_copies":7576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":640,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3788,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3835,"num_write_kb":26730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001271"},"pg_stats":[{"pgid":"4.3f","version":"58'72","reported_seq":149,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.050954+0000","last_change":"2024-06-11T15:59:29.308333+0000","last_active":"2024-06-11T16:00:38.050954+0000","last_peered":"2024-06-11T16:00:38.050954+0000","last_clean":"2024-06-11T16:00:38.050954+0000","last_became_active":"2024-06-11T15:59:29.307745+0000","last_became_peered":"2024-06-11T15:59:29.307745+0000","last_unstale":"2024-06-11T16:00:38.050954+0000","last_undegraded":"2024-06-11T16:00:38.050954+0000","last_fullsized":"2024-06-11T16:00:38.050954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92075,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"58'65","reported_seq":124,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.842598+0000","last_change":"2024-06-11T15:59:47.370239+0000","last_active":"2024-06-11T16:00:37.842598+0000","last_peered":"2024-06-11T16:00:37.842598+0000","last_clean":"2024-06-11T16:00:37.842598+0000","last_became_active":"2024-06-11T15:59:47.370069+0000","last_became_peered":"2024-06-11T15:59:47.370069+0000","last_unstale":"2024-06-11T16:00:37.842598+0000","last_undegraded":"2024-06-11T16:00:37.842598+0000","last_fullsized":"2024-06-11T16:00:37.842598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:09:08.885403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101723,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"58'82","reported_seq":120,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.842658+0000","last_change":"2024-06-11T16:00:06.729026+0000","last_active":"2024-06-11T16:00:37.842658+0000","last_peered":"2024-06-11T16:00:37.842658+0000","last_clean":"2024-06-11T16:00:37.842658+0000","last_became_active":"2024-06-11T16:00:06.726323+0000","last_became_peered":"2024-06-11T16:00:06.726323+0000","last_unstale":"2024-06-11T16:00:37.842658+0000","last_undegraded":"2024-06-11T16:00:37.842658+0000","last_fullsized":"2024-06-11T16:00:37.842658+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:02.777954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140387,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"58'55","reported_seq":106,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.026466+0000","last_change":"2024-06-11T16:00:06.729277+0000","last_active":"2024-06-11T16:00:38.026466+0000","last_peered":"2024-06-11T16:00:38.026466+0000","last_clean":"2024-06-11T16:00:38.026466+0000","last_became_active":"2024-06-11T16:00:06.726878+0000","last_became_peered":"2024-06-11T16:00:06.726878+0000","last_unstale":"2024-06-11T16:00:38.026466+0000","last_undegraded":"2024-06-11T16:00:38.026466+0000","last_fullsized":"2024-06-11T16:00:38.026466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:08.540738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93849,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"58'86","reported_seq":163,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.043490+0000","last_change":"2024-06-11T15:59:29.308058+0000","last_active":"2024-06-11T16:00:38.043490+0000","last_peered":"2024-06-11T16:00:38.043490+0000","last_clean":"2024-06-11T16:00:38.043490+0000","last_became_active":"2024-06-11T15:59:29.307440+0000","last_became_peered":"2024-06-11T15:59:29.307440+0000","last_unstale":"2024-06-11T16:00:38.043490+0000","last_undegraded":"2024-06-11T16:00:38.043490+0000","last_fullsized":"2024-06-11T16:00:38.043490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:33:54.815101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195201,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"58'78","reported_seq":129,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.053519+0000","last_change":"2024-06-11T16:00:06.731814+0000","last_active":"2024-06-11T16:00:38.053519+0000","last_peered":"2024-06-11T16:00:38.053519+0000","last_clean":"2024-06-11T16:00:38.053519+0000","last_became_active":"2024-06-11T16:00:06.730988+0000","last_became_peered":"2024-06-11T16:00:06.730988+0000","last_unstale":"2024-06-11T16:00:38.053519+0000","last_undegraded":"2024-06-11T16:00:38.053519+0000","last_fullsized":"2024-06-11T16:00:38.053519+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:29.963787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187182,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"58'81","reported_seq":132,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.001047+0000","last_change":"2024-06-11T16:00:06.732910+0000","last_active":"2024-06-11T16:00:38.001047+0000","last_peered":"2024-06-11T16:00:38.001047+0000","last_clean":"2024-06-11T16:00:38.001047+0000","last_became_active":"2024-06-11T16:00:06.732336+0000","last_became_peered":"2024-06-11T16:00:06.732336+0000","last_unstale":"2024-06-11T16:00:38.001047+0000","last_undegraded":"2024-06-11T16:00:38.001047+0000","last_fullsized":"2024-06-11T16:00:38.001047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:44:36.351398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152003,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"58'58","reported_seq":109,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.752523+0000","last_change":"2024-06-11T16:00:06.731388+0000","last_active":"2024-06-11T16:00:37.752523+0000","last_peered":"2024-06-11T16:00:37.752523+0000","last_clean":"2024-06-11T16:00:37.752523+0000","last_became_active":"2024-06-11T16:00:06.730852+0000","last_became_peered":"2024-06-11T16:00:06.730852+0000","last_unstale":"2024-06-11T16:00:37.752523+0000","last_undegraded":"2024-06-11T16:00:37.752523+0000","last_fullsized":"2024-06-11T16:00:37.752523+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:52:32.141371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131739,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"58'69","reported_seq":159,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.031250+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:00:38.031250+0000","last_peered":"2024-06-11T16:00:38.031250+0000","last_clean":"2024-06-11T16:00:38.031250+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:00:38.031250+0000","last_undegraded":"2024-06-11T16:00:38.031250+0000","last_fullsized":"2024-06-11T16:00:38.031250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116371,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"58'74","reported_seq":133,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.088918+0000","last_change":"2024-06-11T15:59:47.370396+0000","last_active":"2024-06-11T16:00:38.088918+0000","last_peered":"2024-06-11T16:00:38.088918+0000","last_clean":"2024-06-11T16:00:38.088918+0000","last_became_active":"2024-06-11T15:59:47.370113+0000","last_became_peered":"2024-06-11T15:59:47.370113+0000","last_unstale":"2024-06-11T16:00:38.088918+0000","last_undegraded":"2024-06-11T16:00:38.088918+0000","last_fullsized":"2024-06-11T16:00:38.088918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:05:42.545025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144598,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"58'73","reported_seq":119,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.695262+0000","last_change":"2024-06-11T16:00:32.539261+0000","last_active":"2024-06-11T16:00:37.695262+0000","last_peered":"2024-06-11T16:00:37.695262+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404790+0000","last_became_peered":"2024-06-11T15:59:56.404790+0000","last_unstale":"2024-06-11T16:00:37.695262+0000","last_undegraded":"2024-06-11T16:00:32.480556+0000","last_fullsized":"2024-06-11T15:59:56.401805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:59:59.127937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147129,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":73,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":73}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"58'64","reported_seq":102,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.896994+0000","last_change":"2024-06-11T16:00:06.726442+0000","last_active":"2024-06-11T16:00:37.896994+0000","last_peered":"2024-06-11T16:00:37.896994+0000","last_clean":"2024-06-11T16:00:37.896994+0000","last_became_active":"2024-06-11T16:00:06.725937+0000","last_became_peered":"2024-06-11T16:00:06.725937+0000","last_unstale":"2024-06-11T16:00:37.896994+0000","last_undegraded":"2024-06-11T16:00:37.896994+0000","last_fullsized":"2024-06-11T16:00:37.896994+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:25:12.722872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127842,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"58'57","reported_seq":134,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.044639+0000","last_change":"2024-06-11T15:59:29.308484+0000","last_active":"2024-06-11T16:00:38.044639+0000","last_peered":"2024-06-11T16:00:38.044639+0000","last_clean":"2024-06-11T16:00:38.044639+0000","last_became_active":"2024-06-11T15:59:29.308104+0000","last_became_peered":"2024-06-11T15:59:29.308104+0000","last_unstale":"2024-06-11T16:00:38.044639+0000","last_undegraded":"2024-06-11T16:00:38.044639+0000","last_fullsized":"2024-06-11T16:00:38.044639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197506,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"58'83","reported_seq":129,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.909586+0000","last_change":"2024-06-11T16:00:32.516457+0000","last_active":"2024-06-11T16:00:37.909586+0000","last_peered":"2024-06-11T16:00:37.909586+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403777+0000","last_became_peered":"2024-06-11T15:59:56.403777+0000","last_unstale":"2024-06-11T16:00:37.909586+0000","last_undegraded":"2024-06-11T16:00:32.427033+0000","last_fullsized":"2024-06-11T15:59:56.400876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:28:20.972518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119226,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":83,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":83}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"58'77","reported_seq":115,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.092401+0000","last_change":"2024-06-11T16:00:06.731309+0000","last_active":"2024-06-11T16:00:38.092401+0000","last_peered":"2024-06-11T16:00:38.092401+0000","last_clean":"2024-06-11T16:00:38.092401+0000","last_became_active":"2024-06-11T16:00:06.729334+0000","last_became_peered":"2024-06-11T16:00:06.729334+0000","last_unstale":"2024-06-11T16:00:38.092401+0000","last_undegraded":"2024-06-11T16:00:38.092401+0000","last_fullsized":"2024-06-11T16:00:38.092401+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:29.047874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4403738,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"58'81","reported_seq":127,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:38.003719+0000","last_change":"2024-06-11T16:00:32.425877+0000","last_active":"2024-06-11T16:00:38.003719+0000","last_peered":"2024-06-11T16:00:38.003719+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403626+0000","last_became_peered":"2024-06-11T15:59:56.403626+0000","last_unstale":"2024-06-11T16:00:38.003719+0000","last_undegraded":"2024-06-11T16:00:31.489307+0000","last_fullsized":"2024-06-11T15:59:56.401170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:06:39.398270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4353937,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":81,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":81}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"58'84","reported_seq":174,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.906630+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:00:37.906630+0000","last_peered":"2024-06-11T16:00:37.906630+0000","last_clean":"2024-06-11T16:00:37.906630+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:00:37.906630+0000","last_undegraded":"2024-06-11T16:00:37.906630+0000","last_fullsized":"2024-06-11T16:00:37.906630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183751,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"58'68","reported_seq":127,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.688387+0000","last_change":"2024-06-11T15:59:47.370615+0000","last_active":"2024-06-11T16:00:37.688387+0000","last_peered":"2024-06-11T16:00:37.688387+0000","last_clean":"2024-06-11T16:00:37.688387+0000","last_became_active":"2024-06-11T15:59:47.370447+0000","last_became_peered":"2024-06-11T15:59:47.370447+0000","last_unstale":"2024-06-11T16:00:37.688387+0000","last_undegraded":"2024-06-11T16:00:37.688387+0000","last_fullsized":"2024-06-11T16:00:37.688387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.896374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1437228,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":1449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"58'72","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.773122+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:00:37.773122+0000","last_peered":"2024-06-11T16:00:37.773122+0000","last_clean":"2024-06-11T16:00:37.773122+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:00:37.773122+0000","last_undegraded":"2024-06-11T16:00:37.773122+0000","last_fullsized":"2024-06-11T16:00:37.773122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217328,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"58'88","reported_seq":134,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:38.088034+0000","last_change":"2024-06-11T16:00:30.833258+0000","last_active":"2024-06-11T16:00:38.088034+0000","last_peered":"2024-06-11T16:00:38.088034+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405841+0000","last_became_peered":"2024-06-11T15:59:56.405841+0000","last_unstale":"2024-06-11T16:00:38.088034+0000","last_undegraded":"2024-06-11T16:00:29.735324+0000","last_fullsized":"2024-06-11T15:59:56.402278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:11:45.362411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333967,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":88,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":88}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"58'75","reported_seq":126,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.959828+0000","last_change":"2024-06-11T16:00:06.735178+0000","last_active":"2024-06-11T16:00:37.959828+0000","last_peered":"2024-06-11T16:00:37.959828+0000","last_clean":"2024-06-11T16:00:37.959828+0000","last_became_active":"2024-06-11T16:00:06.734286+0000","last_became_peered":"2024-06-11T16:00:06.734286+0000","last_unstale":"2024-06-11T16:00:37.959828+0000","last_undegraded":"2024-06-11T16:00:37.959828+0000","last_fullsized":"2024-06-11T16:00:37.959828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:17:57.781743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167352,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"58'81","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.979958+0000","last_change":"2024-06-11T16:00:06.730806+0000","last_active":"2024-06-11T16:00:37.979958+0000","last_peered":"2024-06-11T16:00:37.979958+0000","last_clean":"2024-06-11T16:00:37.979958+0000","last_became_active":"2024-06-11T16:00:06.729901+0000","last_became_peered":"2024-06-11T16:00:06.729901+0000","last_unstale":"2024-06-11T16:00:37.979958+0000","last_undegraded":"2024-06-11T16:00:37.979958+0000","last_fullsized":"2024-06-11T16:00:37.979958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:29:29.093801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258912,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"58'75","reported_seq":172,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.040964+0000","last_change":"2024-06-11T16:00:06.733583+0000","last_active":"2024-06-11T16:00:38.040964+0000","last_peered":"2024-06-11T16:00:38.040964+0000","last_clean":"2024-06-11T16:00:38.040964+0000","last_became_active":"2024-06-11T16:00:06.733040+0000","last_became_peered":"2024-06-11T16:00:06.733040+0000","last_unstale":"2024-06-11T16:00:38.040964+0000","last_undegraded":"2024-06-11T16:00:38.040964+0000","last_fullsized":"2024-06-11T16:00:38.040964+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:21.984919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125830,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"58'74","reported_seq":151,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.823357+0000","last_change":"2024-06-11T15:59:29.303643+0000","last_active":"2024-06-11T16:00:37.823357+0000","last_peered":"2024-06-11T16:00:37.823357+0000","last_clean":"2024-06-11T16:00:37.823357+0000","last_became_active":"2024-06-11T15:59:29.303337+0000","last_became_peered":"2024-06-11T15:59:29.303337+0000","last_unstale":"2024-06-11T16:00:37.823357+0000","last_undegraded":"2024-06-11T16:00:37.823357+0000","last_fullsized":"2024-06-11T16:00:37.823357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:10:30.771690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116580,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"58'75","reported_seq":113,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.987131+0000","last_change":"2024-06-11T16:00:06.726945+0000","last_active":"2024-06-11T16:00:37.987131+0000","last_peered":"2024-06-11T16:00:37.987131+0000","last_clean":"2024-06-11T16:00:37.987131+0000","last_became_active":"2024-06-11T16:00:06.726670+0000","last_became_peered":"2024-06-11T16:00:06.726670+0000","last_unstale":"2024-06-11T16:00:37.987131+0000","last_undegraded":"2024-06-11T16:00:37.987131+0000","last_fullsized":"2024-06-11T16:00:37.987131+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:52:48.804955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93804,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"58'86","reported_seq":183,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.973156+0000","last_change":"2024-06-11T16:00:06.730881+0000","last_active":"2024-06-11T16:00:37.973156+0000","last_peered":"2024-06-11T16:00:37.973156+0000","last_clean":"2024-06-11T16:00:37.973156+0000","last_became_active":"2024-06-11T16:00:06.730331+0000","last_became_peered":"2024-06-11T16:00:06.730331+0000","last_unstale":"2024-06-11T16:00:37.973156+0000","last_undegraded":"2024-06-11T16:00:37.973156+0000","last_fullsized":"2024-06-11T16:00:37.973156+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:07:59.680982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403876,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"58'59","reported_seq":97,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854758+0000","last_change":"2024-06-11T16:00:06.732040+0000","last_active":"2024-06-11T16:00:36.854758+0000","last_peered":"2024-06-11T16:00:36.854758+0000","last_clean":"2024-06-11T16:00:36.854758+0000","last_became_active":"2024-06-11T16:00:06.729809+0000","last_became_peered":"2024-06-11T16:00:06.729809+0000","last_unstale":"2024-06-11T16:00:36.854758+0000","last_undegraded":"2024-06-11T16:00:36.854758+0000","last_fullsized":"2024-06-11T16:00:36.854758+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:40:14.285364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88394,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"58'73","reported_seq":154,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.794446+0000","last_change":"2024-06-11T16:00:32.397707+0000","last_active":"2024-06-11T16:00:37.794446+0000","last_peered":"2024-06-11T16:00:37.794446+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.404272+0000","last_became_peered":"2024-06-11T15:59:56.404272+0000","last_unstale":"2024-06-11T16:00:37.794446+0000","last_undegraded":"2024-06-11T16:00:32.387824+0000","last_fullsized":"2024-06-11T15:59:56.401760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:28.107851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220617,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":73,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":73}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"58'75","reported_seq":165,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.995862+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:00:37.995862+0000","last_peered":"2024-06-11T16:00:37.995862+0000","last_clean":"2024-06-11T16:00:37.995862+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:00:37.995862+0000","last_undegraded":"2024-06-11T16:00:37.995862+0000","last_fullsized":"2024-06-11T16:00:37.995862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128460,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"58'85","reported_seq":123,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.075016+0000","last_change":"2024-06-11T16:00:06.728137+0000","last_active":"2024-06-11T16:00:38.075016+0000","last_peered":"2024-06-11T16:00:38.075016+0000","last_clean":"2024-06-11T16:00:38.075016+0000","last_became_active":"2024-06-11T16:00:06.727573+0000","last_became_peered":"2024-06-11T16:00:06.727573+0000","last_unstale":"2024-06-11T16:00:38.075016+0000","last_undegraded":"2024-06-11T16:00:38.075016+0000","last_fullsized":"2024-06-11T16:00:38.075016+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:33:27.695484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512009,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"58'87","reported_seq":177,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.056130+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:00:38.056130+0000","last_peered":"2024-06-11T16:00:38.056130+0000","last_clean":"2024-06-11T16:00:38.056130+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:00:38.056130+0000","last_undegraded":"2024-06-11T16:00:38.056130+0000","last_fullsized":"2024-06-11T16:00:38.056130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201173,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"58'90","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.934178+0000","last_change":"2024-06-11T16:00:06.731265+0000","last_active":"2024-06-11T16:00:37.934178+0000","last_peered":"2024-06-11T16:00:37.934178+0000","last_clean":"2024-06-11T16:00:37.934178+0000","last_became_active":"2024-06-11T16:00:06.730460+0000","last_became_peered":"2024-06-11T16:00:06.730460+0000","last_unstale":"2024-06-11T16:00:37.934178+0000","last_undegraded":"2024-06-11T16:00:37.934178+0000","last_fullsized":"2024-06-11T16:00:37.934178+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:54.914172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179483,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"58'67","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.774962+0000","last_change":"2024-06-11T15:59:29.307780+0000","last_active":"2024-06-11T16:00:37.774962+0000","last_peered":"2024-06-11T16:00:37.774962+0000","last_clean":"2024-06-11T16:00:37.774962+0000","last_became_active":"2024-06-11T15:59:29.307475+0000","last_became_peered":"2024-06-11T15:59:29.307475+0000","last_unstale":"2024-06-11T16:00:37.774962+0000","last_undegraded":"2024-06-11T16:00:37.774962+0000","last_fullsized":"2024-06-11T16:00:37.774962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:04.032746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194106,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'3","reported_seq":58,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:36.855449+0000","last_change":"2024-06-11T15:59:56.404452+0000","last_active":"2024-06-11T16:00:36.855449+0000","last_peered":"2024-06-11T16:00:36.855449+0000","last_clean":"2024-06-11T15:58:59.196469+0000","last_became_active":"2024-06-11T15:59:56.404452+0000","last_became_peered":"2024-06-11T15:59:56.404452+0000","last_unstale":"2024-06-11T16:00:36.855449+0000","last_undegraded":"2024-06-11T15:59:56.401901+0000","last_fullsized":"2024-06-11T15:59:56.401811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:57:31.951964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"58'69","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.878413+0000","last_change":"2024-06-11T15:59:29.308260+0000","last_active":"2024-06-11T16:00:37.878413+0000","last_peered":"2024-06-11T16:00:37.878413+0000","last_clean":"2024-06-11T16:00:37.878413+0000","last_became_active":"2024-06-11T15:59:29.307521+0000","last_became_peered":"2024-06-11T15:59:29.307521+0000","last_unstale":"2024-06-11T16:00:37.878413+0000","last_undegraded":"2024-06-11T16:00:37.878413+0000","last_fullsized":"2024-06-11T16:00:37.878413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:33.415958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101237,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":94,"reported_epoch":58,"state":"active+undersized","last_fresh":"2024-06-11T16:00:36.853608+0000","last_change":"2024-06-11T15:59:56.404430+0000","last_active":"2024-06-11T16:00:36.853608+0000","last_peered":"2024-06-11T16:00:36.853608+0000","last_clean":"2024-06-11T15:59:54.394866+0000","last_became_active":"2024-06-11T15:59:56.404430+0000","last_became_peered":"2024-06-11T15:59:56.404430+0000","last_unstale":"2024-06-11T16:00:36.853608+0000","last_undegraded":"2024-06-11T16:00:36.853608+0000","last_fullsized":"2024-06-11T15:59:56.401724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:31.755176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"58'83","reported_seq":175,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.929148+0000","last_change":"2024-06-11T16:00:32.493364+0000","last_active":"2024-06-11T16:00:37.929148+0000","last_peered":"2024-06-11T16:00:37.929148+0000","last_clean":"2024-06-11T15:59:54.395491+0000","last_became_active":"2024-06-11T15:59:56.407801+0000","last_became_peered":"2024-06-11T15:59:56.407801+0000","last_unstale":"2024-06-11T16:00:37.929148+0000","last_undegraded":"2024-06-11T16:00:32.468476+0000","last_fullsized":"2024-06-11T15:59:56.404860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.264606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143327,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":83,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":83}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.852698+0000","last_change":"2024-06-11T16:00:06.732106+0000","last_active":"2024-06-11T16:00:36.852698+0000","last_peered":"2024-06-11T16:00:36.852698+0000","last_clean":"2024-06-11T16:00:36.852698+0000","last_became_active":"2024-06-11T16:00:06.729443+0000","last_became_peered":"2024-06-11T16:00:06.729443+0000","last_unstale":"2024-06-11T16:00:36.852698+0000","last_undegraded":"2024-06-11T16:00:36.852698+0000","last_fullsized":"2024-06-11T16:00:36.852698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T15:59:04.675026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"58'73","reported_seq":165,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.916176+0000","last_change":"2024-06-11T16:00:32.487444+0000","last_active":"2024-06-11T16:00:37.916176+0000","last_peered":"2024-06-11T16:00:37.916176+0000","last_clean":"2024-06-11T15:59:54.395399+0000","last_became_active":"2024-06-11T15:59:56.405353+0000","last_became_peered":"2024-06-11T15:59:56.405353+0000","last_unstale":"2024-06-11T16:00:37.916176+0000","last_undegraded":"2024-06-11T16:00:32.427641+0000","last_fullsized":"2024-06-11T15:59:56.402136+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:36.827812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222288,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":73,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":73}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.852630+0000","last_change":"2024-06-11T16:00:06.750390+0000","last_active":"2024-06-11T16:00:36.852630+0000","last_peered":"2024-06-11T16:00:36.852630+0000","last_clean":"2024-06-11T16:00:36.852630+0000","last_became_active":"2024-06-11T16:00:06.730127+0000","last_became_peered":"2024-06-11T16:00:06.730127+0000","last_unstale":"2024-06-11T16:00:36.852630+0000","last_undegraded":"2024-06-11T16:00:36.852630+0000","last_fullsized":"2024-06-11T16:00:36.852630+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:47.680585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":57,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:36.851086+0000","last_change":"2024-06-11T15:59:56.404250+0000","last_active":"2024-06-11T16:00:36.851086+0000","last_peered":"2024-06-11T16:00:36.851086+0000","last_clean":"2024-06-11T15:58:59.195790+0000","last_became_active":"2024-06-11T15:59:56.404250+0000","last_became_peered":"2024-06-11T15:59:56.404250+0000","last_unstale":"2024-06-11T16:00:36.851086+0000","last_undegraded":"2024-06-11T15:59:56.401382+0000","last_fullsized":"2024-06-11T15:59:56.401309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:59:20.671244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"58'70","reported_seq":134,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:37.991578+0000","last_change":"2024-06-11T16:00:32.619682+0000","last_active":"2024-06-11T16:00:37.991578+0000","last_peered":"2024-06-11T16:00:37.991578+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.403389+0000","last_became_peered":"2024-06-11T15:59:56.403389+0000","last_unstale":"2024-06-11T16:00:37.991578+0000","last_undegraded":"2024-06-11T16:00:32.504618+0000","last_fullsized":"2024-06-11T15:59:56.400803+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:40.161483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282098,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":70,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":70}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854197+0000","last_change":"2024-06-11T16:00:06.759672+0000","last_active":"2024-06-11T16:00:36.854197+0000","last_peered":"2024-06-11T16:00:36.854197+0000","last_clean":"2024-06-11T16:00:36.854197+0000","last_became_active":"2024-06-11T16:00:06.732503+0000","last_became_peered":"2024-06-11T16:00:06.732503+0000","last_unstale":"2024-06-11T16:00:36.854197+0000","last_undegraded":"2024-06-11T16:00:36.854197+0000","last_fullsized":"2024-06-11T16:00:36.854197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"58'81","reported_seq":158,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.017912+0000","last_change":"2024-06-11T15:59:29.305115+0000","last_active":"2024-06-11T16:00:38.017912+0000","last_peered":"2024-06-11T16:00:38.017912+0000","last_clean":"2024-06-11T16:00:38.017912+0000","last_became_active":"2024-06-11T15:59:29.304789+0000","last_became_peered":"2024-06-11T15:59:29.304789+0000","last_unstale":"2024-06-11T16:00:38.017912+0000","last_undegraded":"2024-06-11T16:00:38.017912+0000","last_fullsized":"2024-06-11T16:00:38.017912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:08:21.411683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273291,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853401+0000","last_change":"2024-06-11T16:00:06.741350+0000","last_active":"2024-06-11T16:00:36.853401+0000","last_peered":"2024-06-11T16:00:36.853401+0000","last_clean":"2024-06-11T16:00:36.853401+0000","last_became_active":"2024-06-11T16:00:06.726679+0000","last_became_peered":"2024-06-11T16:00:06.726679+0000","last_unstale":"2024-06-11T16:00:36.853401+0000","last_undegraded":"2024-06-11T16:00:36.853401+0000","last_fullsized":"2024-06-11T16:00:36.853401+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:59.285822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"58'78","reported_seq":129,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.032295+0000","last_change":"2024-06-11T16:00:06.734561+0000","last_active":"2024-06-11T16:00:38.032295+0000","last_peered":"2024-06-11T16:00:38.032295+0000","last_clean":"2024-06-11T16:00:38.032295+0000","last_became_active":"2024-06-11T16:00:06.734361+0000","last_became_peered":"2024-06-11T16:00:06.734361+0000","last_unstale":"2024-06-11T16:00:38.032295+0000","last_undegraded":"2024-06-11T16:00:38.032295+0000","last_fullsized":"2024-06-11T16:00:38.032295+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:32.369019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137974,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854838+0000","last_change":"2024-06-11T16:00:06.731134+0000","last_active":"2024-06-11T16:00:36.854838+0000","last_peered":"2024-06-11T16:00:36.854838+0000","last_clean":"2024-06-11T16:00:36.854838+0000","last_became_active":"2024-06-11T16:00:06.727963+0000","last_became_peered":"2024-06-11T16:00:06.727963+0000","last_unstale":"2024-06-11T16:00:36.854838+0000","last_undegraded":"2024-06-11T16:00:36.854838+0000","last_fullsized":"2024-06-11T16:00:36.854838+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:50.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"58'71","reported_seq":168,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.948729+0000","last_change":"2024-06-11T16:00:06.736430+0000","last_active":"2024-06-11T16:00:37.948729+0000","last_peered":"2024-06-11T16:00:37.948729+0000","last_clean":"2024-06-11T16:00:37.948729+0000","last_became_active":"2024-06-11T16:00:06.736127+0000","last_became_peered":"2024-06-11T16:00:06.736127+0000","last_unstale":"2024-06-11T16:00:37.948729+0000","last_undegraded":"2024-06-11T16:00:37.948729+0000","last_fullsized":"2024-06-11T16:00:37.948729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:53:27.265136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267067,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":115,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.858394+0000","last_change":"2024-06-11T16:00:06.762561+0000","last_active":"2024-06-11T16:00:36.858394+0000","last_peered":"2024-06-11T16:00:36.858394+0000","last_clean":"2024-06-11T16:00:36.858394+0000","last_became_active":"2024-06-11T16:00:06.735732+0000","last_became_peered":"2024-06-11T16:00:06.735732+0000","last_unstale":"2024-06-11T16:00:36.858394+0000","last_undegraded":"2024-06-11T16:00:36.858394+0000","last_fullsized":"2024-06-11T16:00:36.858394+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:38.902662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"58'80","reported_seq":131,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.932943+0000","last_change":"2024-06-11T16:00:06.729036+0000","last_active":"2024-06-11T16:00:37.932943+0000","last_peered":"2024-06-11T16:00:37.932943+0000","last_clean":"2024-06-11T16:00:37.932943+0000","last_became_active":"2024-06-11T16:00:06.726799+0000","last_became_peered":"2024-06-11T16:00:06.726799+0000","last_unstale":"2024-06-11T16:00:37.932943+0000","last_undegraded":"2024-06-11T16:00:37.932943+0000","last_fullsized":"2024-06-11T16:00:37.932943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:31.484951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192990,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+undersized","last_fresh":"2024-06-11T16:00:36.853220+0000","last_change":"2024-06-11T15:59:56.403784+0000","last_active":"2024-06-11T16:00:36.853220+0000","last_peered":"2024-06-11T16:00:36.853220+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403784+0000","last_became_peered":"2024-06-11T15:59:56.403784+0000","last_unstale":"2024-06-11T16:00:36.853220+0000","last_undegraded":"2024-06-11T16:00:36.853220+0000","last_fullsized":"2024-06-11T15:59:56.401221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"58'72","reported_seq":110,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.984783+0000","last_change":"2024-06-11T16:00:06.731326+0000","last_active":"2024-06-11T16:00:37.984783+0000","last_peered":"2024-06-11T16:00:37.984783+0000","last_clean":"2024-06-11T16:00:37.984783+0000","last_became_active":"2024-06-11T16:00:06.730397+0000","last_became_peered":"2024-06-11T16:00:06.730397+0000","last_unstale":"2024-06-11T16:00:37.984783+0000","last_undegraded":"2024-06-11T16:00:37.984783+0000","last_fullsized":"2024-06-11T16:00:37.984783+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:51:36.033362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322545,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":58,"state":"active+undersized","last_fresh":"2024-06-11T16:00:36.850447+0000","last_change":"2024-06-11T15:59:56.405129+0000","last_active":"2024-06-11T16:00:36.850447+0000","last_peered":"2024-06-11T16:00:36.850447+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.405129+0000","last_became_peered":"2024-06-11T15:59:56.405129+0000","last_unstale":"2024-06-11T16:00:36.850447+0000","last_undegraded":"2024-06-11T16:00:36.850447+0000","last_fullsized":"2024-06-11T15:59:56.402039+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:57.335346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"58'55","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.086193+0000","last_change":"2024-06-11T16:00:06.729783+0000","last_active":"2024-06-11T16:00:38.086193+0000","last_peered":"2024-06-11T16:00:38.086193+0000","last_clean":"2024-06-11T16:00:38.086193+0000","last_became_active":"2024-06-11T16:00:06.728895+0000","last_became_peered":"2024-06-11T16:00:06.728895+0000","last_unstale":"2024-06-11T16:00:38.086193+0000","last_undegraded":"2024-06-11T16:00:38.086193+0000","last_fullsized":"2024-06-11T16:00:38.086193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:23:47.804555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83903,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853112+0000","last_change":"2024-06-11T15:59:47.370077+0000","last_active":"2024-06-11T16:00:36.853112+0000","last_peered":"2024-06-11T16:00:36.853112+0000","last_clean":"2024-06-11T16:00:36.853112+0000","last_became_active":"2024-06-11T15:59:47.369829+0000","last_became_peered":"2024-06-11T15:59:47.369829+0000","last_unstale":"2024-06-11T16:00:36.853112+0000","last_undegraded":"2024-06-11T16:00:36.853112+0000","last_fullsized":"2024-06-11T16:00:36.853112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:39:16.276410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"58'64","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.982777+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:00:37.982777+0000","last_peered":"2024-06-11T16:00:37.982777+0000","last_clean":"2024-06-11T16:00:37.982777+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:00:37.982777+0000","last_undegraded":"2024-06-11T16:00:37.982777+0000","last_fullsized":"2024-06-11T16:00:37.982777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168179,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":253,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853534+0000","last_change":"2024-06-11T16:00:09.739640+0000","last_active":"2024-06-11T16:00:36.853534+0000","last_peered":"2024-06-11T16:00:36.853534+0000","last_clean":"2024-06-11T16:00:36.853534+0000","last_became_active":"2024-06-11T16:00:09.739392+0000","last_became_peered":"2024-06-11T16:00:09.739392+0000","last_unstale":"2024-06-11T16:00:36.853534+0000","last_undegraded":"2024-06-11T16:00:36.853534+0000","last_fullsized":"2024-06-11T16:00:36.853534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:15.633968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.858380+0000","last_change":"2024-06-11T16:00:06.736403+0000","last_active":"2024-06-11T16:00:36.858380+0000","last_peered":"2024-06-11T16:00:36.858380+0000","last_clean":"2024-06-11T16:00:36.858380+0000","last_became_active":"2024-06-11T16:00:06.736220+0000","last_became_peered":"2024-06-11T16:00:06.736220+0000","last_unstale":"2024-06-11T16:00:36.858380+0000","last_undegraded":"2024-06-11T16:00:36.858380+0000","last_fullsized":"2024-06-11T16:00:36.858380+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:42.907390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853811+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:00:36.853811+0000","last_peered":"2024-06-11T16:00:36.853811+0000","last_clean":"2024-06-11T16:00:36.853811+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:00:36.853811+0000","last_undegraded":"2024-06-11T16:00:36.853811+0000","last_fullsized":"2024-06-11T16:00:36.853811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"58'71","reported_seq":109,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.988142+0000","last_change":"2024-06-11T16:00:06.730859+0000","last_active":"2024-06-11T16:00:37.988142+0000","last_peered":"2024-06-11T16:00:37.988142+0000","last_clean":"2024-06-11T16:00:37.988142+0000","last_became_active":"2024-06-11T16:00:06.727651+0000","last_became_peered":"2024-06-11T16:00:06.727651+0000","last_unstale":"2024-06-11T16:00:37.988142+0000","last_undegraded":"2024-06-11T16:00:37.988142+0000","last_fullsized":"2024-06-11T16:00:37.988142+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:27.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182312,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.852749+0000","last_change":"2024-06-11T16:00:06.728896+0000","last_active":"2024-06-11T16:00:36.852749+0000","last_peered":"2024-06-11T16:00:36.852749+0000","last_clean":"2024-06-11T16:00:36.852749+0000","last_became_active":"2024-06-11T16:00:06.725941+0000","last_became_peered":"2024-06-11T16:00:06.725941+0000","last_unstale":"2024-06-11T16:00:36.852749+0000","last_undegraded":"2024-06-11T16:00:36.852749+0000","last_fullsized":"2024-06-11T16:00:36.852749+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:09:26.215218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"56'5","reported_seq":108,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854037+0000","last_change":"2024-06-11T16:00:06.734401+0000","last_active":"2024-06-11T16:00:36.854037+0000","last_peered":"2024-06-11T16:00:36.854037+0000","last_clean":"2024-06-11T16:00:36.854037+0000","last_became_active":"2024-06-11T16:00:06.733591+0000","last_became_peered":"2024-06-11T16:00:06.733591+0000","last_unstale":"2024-06-11T16:00:36.854037+0000","last_undegraded":"2024-06-11T16:00:36.854037+0000","last_fullsized":"2024-06-11T16:00:36.854037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:53:07.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1717,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"58'75","reported_seq":152,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.030735+0000","last_change":"2024-06-11T15:59:29.308305+0000","last_active":"2024-06-11T16:00:38.030735+0000","last_peered":"2024-06-11T16:00:38.030735+0000","last_clean":"2024-06-11T16:00:38.030735+0000","last_became_active":"2024-06-11T15:59:29.307739+0000","last_became_peered":"2024-06-11T15:59:29.307739+0000","last_unstale":"2024-06-11T16:00:38.030735+0000","last_undegraded":"2024-06-11T16:00:38.030735+0000","last_fullsized":"2024-06-11T16:00:38.030735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:37.529774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":302654,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854083+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:00:36.854083+0000","last_peered":"2024-06-11T16:00:36.854083+0000","last_clean":"2024-06-11T16:00:36.854083+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:00:36.854083+0000","last_undegraded":"2024-06-11T16:00:36.854083+0000","last_fullsized":"2024-06-11T16:00:36.854083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"57'1","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.852663+0000","last_change":"2024-06-11T16:00:06.731161+0000","last_active":"2024-06-11T16:00:36.852663+0000","last_peered":"2024-06-11T16:00:36.852663+0000","last_clean":"2024-06-11T16:00:36.852663+0000","last_became_active":"2024-06-11T16:00:06.730198+0000","last_became_peered":"2024-06-11T16:00:06.730198+0000","last_unstale":"2024-06-11T16:00:36.852663+0000","last_undegraded":"2024-06-11T16:00:36.852663+0000","last_fullsized":"2024-06-11T16:00:36.852663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:50:45.550094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"58'75","reported_seq":165,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.072247+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:00:38.072247+0000","last_peered":"2024-06-11T16:00:38.072247+0000","last_clean":"2024-06-11T16:00:38.072247+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:00:38.072247+0000","last_undegraded":"2024-06-11T16:00:38.072247+0000","last_fullsized":"2024-06-11T16:00:38.072247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405022,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853823+0000","last_change":"2024-06-11T16:00:06.733390+0000","last_active":"2024-06-11T16:00:36.853823+0000","last_peered":"2024-06-11T16:00:36.853823+0000","last_clean":"2024-06-11T16:00:36.853823+0000","last_became_active":"2024-06-11T16:00:06.733129+0000","last_became_peered":"2024-06-11T16:00:06.733129+0000","last_unstale":"2024-06-11T16:00:36.853823+0000","last_undegraded":"2024-06-11T16:00:36.853823+0000","last_fullsized":"2024-06-11T16:00:36.853823+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:04:02.257999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.855546+0000","last_change":"2024-06-11T16:00:06.735376+0000","last_active":"2024-06-11T16:00:36.855546+0000","last_peered":"2024-06-11T16:00:36.855546+0000","last_clean":"2024-06-11T16:00:36.855546+0000","last_became_active":"2024-06-11T16:00:06.734349+0000","last_became_peered":"2024-06-11T16:00:06.734349+0000","last_unstale":"2024-06-11T16:00:36.855546+0000","last_undegraded":"2024-06-11T16:00:36.855546+0000","last_fullsized":"2024-06-11T16:00:36.855546+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:57.761478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"58'70","reported_seq":160,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.083553+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:00:38.083553+0000","last_peered":"2024-06-11T16:00:38.083553+0000","last_clean":"2024-06-11T16:00:38.083553+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:00:38.083553+0000","last_undegraded":"2024-06-11T16:00:38.083553+0000","last_fullsized":"2024-06-11T16:00:38.083553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97942,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+undersized","last_fresh":"2024-06-11T16:00:36.854348+0000","last_change":"2024-06-11T15:59:56.403576+0000","last_active":"2024-06-11T16:00:36.854348+0000","last_peered":"2024-06-11T16:00:36.854348+0000","last_clean":"2024-06-11T15:58:57.155352+0000","last_became_active":"2024-06-11T15:59:56.403576+0000","last_became_peered":"2024-06-11T15:59:56.403576+0000","last_unstale":"2024-06-11T16:00:36.854348+0000","last_undegraded":"2024-06-11T16:00:36.854348+0000","last_fullsized":"2024-06-11T15:59:56.402056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:59:03.781359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.855013+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:00:36.855013+0000","last_peered":"2024-06-11T16:00:36.855013+0000","last_clean":"2024-06-11T16:00:36.855013+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:00:36.855013+0000","last_undegraded":"2024-06-11T16:00:36.855013+0000","last_fullsized":"2024-06-11T16:00:36.855013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"58'68","reported_seq":106,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.891968+0000","last_change":"2024-06-11T16:00:06.730456+0000","last_active":"2024-06-11T16:00:37.891968+0000","last_peered":"2024-06-11T16:00:37.891968+0000","last_clean":"2024-06-11T16:00:37.891968+0000","last_became_active":"2024-06-11T16:00:06.729977+0000","last_became_peered":"2024-06-11T16:00:06.729977+0000","last_unstale":"2024-06-11T16:00:37.891968+0000","last_undegraded":"2024-06-11T16:00:37.891968+0000","last_fullsized":"2024-06-11T16:00:37.891968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:55:24.550321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124119,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854971+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:00:36.854971+0000","last_peered":"2024-06-11T16:00:36.854971+0000","last_clean":"2024-06-11T16:00:36.854971+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:00:36.854971+0000","last_undegraded":"2024-06-11T16:00:36.854971+0000","last_fullsized":"2024-06-11T16:00:36.854971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854709+0000","last_change":"2024-06-11T15:59:29.308481+0000","last_active":"2024-06-11T16:00:36.854709+0000","last_peered":"2024-06-11T16:00:36.854709+0000","last_clean":"2024-06-11T16:00:36.854709+0000","last_became_active":"2024-06-11T15:59:29.307986+0000","last_became_peered":"2024-06-11T15:59:29.307986+0000","last_unstale":"2024-06-11T16:00:36.854709+0000","last_undegraded":"2024-06-11T16:00:36.854709+0000","last_fullsized":"2024-06-11T16:00:36.854709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:20.285064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"58'86","reported_seq":124,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.897254+0000","last_change":"2024-06-11T16:00:06.733056+0000","last_active":"2024-06-11T16:00:37.897254+0000","last_peered":"2024-06-11T16:00:37.897254+0000","last_clean":"2024-06-11T16:00:37.897254+0000","last_became_active":"2024-06-11T16:00:06.732005+0000","last_became_peered":"2024-06-11T16:00:06.732005+0000","last_unstale":"2024-06-11T16:00:37.897254+0000","last_undegraded":"2024-06-11T16:00:37.897254+0000","last_fullsized":"2024-06-11T16:00:37.897254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:56:26.626148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208729,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854346+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:00:36.854346+0000","last_peered":"2024-06-11T16:00:36.854346+0000","last_clean":"2024-06-11T16:00:36.854346+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:00:36.854346+0000","last_undegraded":"2024-06-11T16:00:36.854346+0000","last_fullsized":"2024-06-11T16:00:36.854346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854974+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:00:36.854974+0000","last_peered":"2024-06-11T16:00:36.854974+0000","last_clean":"2024-06-11T16:00:36.854974+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:00:36.854974+0000","last_undegraded":"2024-06-11T16:00:36.854974+0000","last_fullsized":"2024-06-11T16:00:36.854974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"58'63","reported_seq":160,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.923780+0000","last_change":"2024-06-11T16:00:06.733052+0000","last_active":"2024-06-11T16:00:37.923780+0000","last_peered":"2024-06-11T16:00:37.923780+0000","last_clean":"2024-06-11T16:00:37.923780+0000","last_became_active":"2024-06-11T16:00:06.730909+0000","last_became_peered":"2024-06-11T16:00:06.730909+0000","last_unstale":"2024-06-11T16:00:37.923780+0000","last_undegraded":"2024-06-11T16:00:37.923780+0000","last_fullsized":"2024-06-11T16:00:37.923780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:02:35.977811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142690,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"58'14","reported_seq":117,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854922+0000","last_change":"2024-06-11T16:00:06.761223+0000","last_active":"2024-06-11T16:00:36.854922+0000","last_peered":"2024-06-11T16:00:36.854922+0000","last_clean":"2024-06-11T16:00:36.854922+0000","last_became_active":"2024-06-11T16:00:06.733534+0000","last_became_peered":"2024-06-11T16:00:06.733534+0000","last_unstale":"2024-06-11T16:00:36.854922+0000","last_undegraded":"2024-06-11T16:00:36.854922+0000","last_fullsized":"2024-06-11T16:00:36.854922+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:25.557309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":58,"state":"active+undersized","last_fresh":"2024-06-11T16:00:36.851494+0000","last_change":"2024-06-11T15:59:56.406049+0000","last_active":"2024-06-11T16:00:36.851494+0000","last_peered":"2024-06-11T16:00:36.851494+0000","last_clean":"2024-06-11T15:58:55.147970+0000","last_became_active":"2024-06-11T15:59:56.406049+0000","last_became_peered":"2024-06-11T15:59:56.406049+0000","last_unstale":"2024-06-11T16:00:36.851494+0000","last_undegraded":"2024-06-11T16:00:36.851494+0000","last_fullsized":"2024-06-11T15:59:56.403036+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:51:56.943518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"58'64","reported_seq":102,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.839750+0000","last_change":"2024-06-11T16:00:06.732366+0000","last_active":"2024-06-11T16:00:37.839750+0000","last_peered":"2024-06-11T16:00:37.839750+0000","last_clean":"2024-06-11T16:00:37.839750+0000","last_became_active":"2024-06-11T16:00:06.729985+0000","last_became_peered":"2024-06-11T16:00:06.729985+0000","last_unstale":"2024-06-11T16:00:37.839750+0000","last_undegraded":"2024-06-11T16:00:37.839750+0000","last_fullsized":"2024-06-11T16:00:37.839750+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:26:03.026776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249503,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"58'74","reported_seq":112,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.990699+0000","last_change":"2024-06-11T16:00:06.732542+0000","last_active":"2024-06-11T16:00:37.990699+0000","last_peered":"2024-06-11T16:00:37.990699+0000","last_clean":"2024-06-11T16:00:37.990699+0000","last_became_active":"2024-06-11T16:00:06.731255+0000","last_became_peered":"2024-06-11T16:00:06.731255+0000","last_unstale":"2024-06-11T16:00:37.990699+0000","last_undegraded":"2024-06-11T16:00:37.990699+0000","last_fullsized":"2024-06-11T16:00:37.990699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:04:19.929277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178225,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"56'48","reported_seq":112,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:36.850624+0000","last_change":"2024-06-11T15:59:56.404029+0000","last_active":"2024-06-11T16:00:36.850624+0000","last_peered":"2024-06-11T16:00:36.850624+0000","last_clean":"2024-06-11T15:59:24.509079+0000","last_became_active":"2024-06-11T15:59:56.404029+0000","last_became_peered":"2024-06-11T15:59:56.404029+0000","last_unstale":"2024-06-11T16:00:36.850624+0000","last_undegraded":"2024-06-11T15:59:56.401205+0000","last_fullsized":"2024-06-11T15:59:56.401119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:09.685489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":4}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"58'67","reported_seq":157,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.018837+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:00:38.018837+0000","last_peered":"2024-06-11T16:00:38.018837+0000","last_clean":"2024-06-11T16:00:38.018837+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:00:38.018837+0000","last_undegraded":"2024-06-11T16:00:38.018837+0000","last_fullsized":"2024-06-11T16:00:38.018837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118125,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"56'7","reported_seq":90,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:36.851036+0000","last_change":"2024-06-11T15:59:56.407748+0000","last_active":"2024-06-11T16:00:36.851036+0000","last_peered":"2024-06-11T16:00:36.851036+0000","last_clean":"2024-06-11T15:59:45.515376+0000","last_became_active":"2024-06-11T15:59:56.407748+0000","last_became_peered":"2024-06-11T15:59:56.407748+0000","last_unstale":"2024-06-11T16:00:36.851036+0000","last_undegraded":"2024-06-11T15:59:56.405775+0000","last_fullsized":"2024-06-11T15:59:56.405701+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:00.944820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":52,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854048+0000","last_change":"2024-06-11T16:00:06.729785+0000","last_active":"2024-06-11T16:00:36.854048+0000","last_peered":"2024-06-11T16:00:36.854048+0000","last_clean":"2024-06-11T16:00:36.854048+0000","last_became_active":"2024-06-11T16:00:06.728029+0000","last_became_peered":"2024-06-11T16:00:06.728029+0000","last_unstale":"2024-06-11T16:00:36.854048+0000","last_undegraded":"2024-06-11T16:00:36.854048+0000","last_fullsized":"2024-06-11T16:00:36.854048+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:40.886742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"58'75","reported_seq":172,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.077970+0000","last_change":"2024-06-11T16:00:06.734202+0000","last_active":"2024-06-11T16:00:38.077970+0000","last_peered":"2024-06-11T16:00:38.077970+0000","last_clean":"2024-06-11T16:00:38.077970+0000","last_became_active":"2024-06-11T16:00:06.733217+0000","last_became_peered":"2024-06-11T16:00:06.733217+0000","last_unstale":"2024-06-11T16:00:38.077970+0000","last_undegraded":"2024-06-11T16:00:38.077970+0000","last_fullsized":"2024-06-11T16:00:38.077970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:31.247464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168507,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":100,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854206+0000","last_change":"2024-06-11T16:00:06.732126+0000","last_active":"2024-06-11T16:00:36.854206+0000","last_peered":"2024-06-11T16:00:36.854206+0000","last_clean":"2024-06-11T16:00:36.854206+0000","last_became_active":"2024-06-11T16:00:06.731826+0000","last_became_peered":"2024-06-11T16:00:06.731826+0000","last_unstale":"2024-06-11T16:00:36.854206+0000","last_undegraded":"2024-06-11T16:00:36.854206+0000","last_fullsized":"2024-06-11T16:00:36.854206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:40:27.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"58'70","reported_seq":160,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.960940+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:00:37.960940+0000","last_peered":"2024-06-11T16:00:37.960940+0000","last_clean":"2024-06-11T16:00:37.960940+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:00:37.960940+0000","last_undegraded":"2024-06-11T16:00:37.960940+0000","last_fullsized":"2024-06-11T16:00:37.960940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123453,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"58'80","reported_seq":144,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:38.016345+0000","last_change":"2024-06-11T16:00:32.514189+0000","last_active":"2024-06-11T16:00:38.016345+0000","last_peered":"2024-06-11T16:00:38.016345+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.405793+0000","last_became_peered":"2024-06-11T15:59:56.405793+0000","last_unstale":"2024-06-11T16:00:38.016345+0000","last_undegraded":"2024-06-11T16:00:32.410852+0000","last_fullsized":"2024-06-11T15:59:56.402292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:42:36.697100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247078,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":79,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":79}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853605+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:00:36.853605+0000","last_peered":"2024-06-11T16:00:36.853605+0000","last_clean":"2024-06-11T16:00:36.853605+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:00:36.853605+0000","last_undegraded":"2024-06-11T16:00:36.853605+0000","last_fullsized":"2024-06-11T16:00:36.853605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"58'75","reported_seq":172,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.701785+0000","last_change":"2024-06-11T16:00:06.733930+0000","last_active":"2024-06-11T16:00:37.701785+0000","last_peered":"2024-06-11T16:00:37.701785+0000","last_clean":"2024-06-11T16:00:37.701785+0000","last_became_active":"2024-06-11T16:00:06.733386+0000","last_became_peered":"2024-06-11T16:00:06.733386+0000","last_unstale":"2024-06-11T16:00:37.701785+0000","last_undegraded":"2024-06-11T16:00:37.701785+0000","last_fullsized":"2024-06-11T16:00:37.701785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:38:34.805513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122206,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":99,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.853693+0000","last_change":"2024-06-11T16:00:06.735029+0000","last_active":"2024-06-11T16:00:36.853693+0000","last_peered":"2024-06-11T16:00:36.853693+0000","last_clean":"2024-06-11T16:00:36.853693+0000","last_became_active":"2024-06-11T16:00:06.733409+0000","last_became_peered":"2024-06-11T16:00:06.733409+0000","last_unstale":"2024-06-11T16:00:36.853693+0000","last_undegraded":"2024-06-11T16:00:36.853693+0000","last_fullsized":"2024-06-11T16:00:36.853693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"58'68","reported_seq":106,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.080891+0000","last_change":"2024-06-11T16:00:06.731080+0000","last_active":"2024-06-11T16:00:38.080891+0000","last_peered":"2024-06-11T16:00:38.080891+0000","last_clean":"2024-06-11T16:00:38.080891+0000","last_became_active":"2024-06-11T16:00:06.727597+0000","last_became_peered":"2024-06-11T16:00:06.727597+0000","last_unstale":"2024-06-11T16:00:38.080891+0000","last_undegraded":"2024-06-11T16:00:38.080891+0000","last_fullsized":"2024-06-11T16:00:38.080891+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:52:27.028359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118630,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'3","reported_seq":80,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.508848+0000","last_change":"2024-06-11T15:59:29.305122+0000","last_active":"2024-06-11T16:00:37.508848+0000","last_peered":"2024-06-11T16:00:37.508848+0000","last_clean":"2024-06-11T16:00:37.508848+0000","last_became_active":"2024-06-11T15:59:29.304793+0000","last_became_peered":"2024-06-11T15:59:29.304793+0000","last_unstale":"2024-06-11T16:00:37.508848+0000","last_undegraded":"2024-06-11T16:00:37.508848+0000","last_fullsized":"2024-06-11T16:00:37.508848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:30:40.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":378320,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"58'70","reported_seq":147,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.038752+0000","last_change":"2024-06-11T15:59:29.308065+0000","last_active":"2024-06-11T16:00:38.038752+0000","last_peered":"2024-06-11T16:00:38.038752+0000","last_clean":"2024-06-11T16:00:38.038752+0000","last_became_active":"2024-06-11T15:59:29.307541+0000","last_became_peered":"2024-06-11T15:59:29.307541+0000","last_unstale":"2024-06-11T16:00:38.038752+0000","last_undegraded":"2024-06-11T16:00:38.038752+0000","last_fullsized":"2024-06-11T16:00:38.038752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:01:30.960914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179674,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"56'5","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854721+0000","last_change":"2024-06-11T16:00:06.733548+0000","last_active":"2024-06-11T16:00:36.854721+0000","last_peered":"2024-06-11T16:00:36.854721+0000","last_clean":"2024-06-11T16:00:36.854721+0000","last_became_active":"2024-06-11T16:00:06.732173+0000","last_became_peered":"2024-06-11T16:00:06.732173+0000","last_unstale":"2024-06-11T16:00:36.854721+0000","last_undegraded":"2024-06-11T16:00:36.854721+0000","last_fullsized":"2024-06-11T16:00:36.854721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:49.916407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"58'73","reported_seq":124,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.072273+0000","last_change":"2024-06-11T16:00:06.732865+0000","last_active":"2024-06-11T16:00:38.072273+0000","last_peered":"2024-06-11T16:00:38.072273+0000","last_clean":"2024-06-11T16:00:38.072273+0000","last_became_active":"2024-06-11T16:00:06.731899+0000","last_became_peered":"2024-06-11T16:00:06.731899+0000","last_unstale":"2024-06-11T16:00:38.072273+0000","last_undegraded":"2024-06-11T16:00:38.072273+0000","last_fullsized":"2024-06-11T16:00:38.072273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:26:57.512382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3917773,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854877+0000","last_change":"2024-06-11T16:00:06.742695+0000","last_active":"2024-06-11T16:00:36.854877+0000","last_peered":"2024-06-11T16:00:36.854877+0000","last_clean":"2024-06-11T16:00:36.854877+0000","last_became_active":"2024-06-11T16:00:06.729796+0000","last_became_peered":"2024-06-11T16:00:06.729796+0000","last_unstale":"2024-06-11T16:00:36.854877+0000","last_undegraded":"2024-06-11T16:00:36.854877+0000","last_fullsized":"2024-06-11T16:00:36.854877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:42:13.786513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"58'65","reported_seq":116,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.007485+0000","last_change":"2024-06-11T16:00:06.731819+0000","last_active":"2024-06-11T16:00:38.007485+0000","last_peered":"2024-06-11T16:00:38.007485+0000","last_clean":"2024-06-11T16:00:38.007485+0000","last_became_active":"2024-06-11T16:00:06.731150+0000","last_became_peered":"2024-06-11T16:00:06.731150+0000","last_unstale":"2024-06-11T16:00:38.007485+0000","last_undegraded":"2024-06-11T16:00:38.007485+0000","last_fullsized":"2024-06-11T16:00:38.007485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:55:26.515232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167396,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"56'5","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854235+0000","last_change":"2024-06-11T16:00:06.753989+0000","last_active":"2024-06-11T16:00:36.854235+0000","last_peered":"2024-06-11T16:00:36.854235+0000","last_clean":"2024-06-11T16:00:36.854235+0000","last_became_active":"2024-06-11T16:00:06.731991+0000","last_became_peered":"2024-06-11T16:00:06.731991+0000","last_unstale":"2024-06-11T16:00:36.854235+0000","last_undegraded":"2024-06-11T16:00:36.854235+0000","last_fullsized":"2024-06-11T16:00:36.854235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:35:10.544048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"58'74","reported_seq":151,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:38.007543+0000","last_change":"2024-06-11T15:59:29.308075+0000","last_active":"2024-06-11T16:00:38.007543+0000","last_peered":"2024-06-11T16:00:38.007543+0000","last_clean":"2024-06-11T16:00:38.007543+0000","last_became_active":"2024-06-11T15:59:29.307570+0000","last_became_peered":"2024-06-11T15:59:29.307570+0000","last_unstale":"2024-06-11T16:00:38.007543+0000","last_undegraded":"2024-06-11T16:00:38.007543+0000","last_fullsized":"2024-06-11T16:00:38.007543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:41.270065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":266206,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":93,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:36.854540+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:00:36.854540+0000","last_peered":"2024-06-11T16:00:36.854540+0000","last_clean":"2024-06-11T16:00:36.854540+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:00:36.854540+0000","last_undegraded":"2024-06-11T16:00:36.854540+0000","last_fullsized":"2024-06-11T16:00:36.854540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"58'89","reported_seq":135,"reported_epoch":58,"state":"active+undersized+degraded","last_fresh":"2024-06-11T16:00:38.022259+0000","last_change":"2024-06-11T16:00:32.494350+0000","last_active":"2024-06-11T16:00:38.022259+0000","last_peered":"2024-06-11T16:00:38.022259+0000","last_clean":"2024-06-11T15:58:58.156618+0000","last_became_active":"2024-06-11T15:59:56.402742+0000","last_became_peered":"2024-06-11T15:59:56.402742+0000","last_unstale":"2024-06-11T16:00:38.022259+0000","last_undegraded":"2024-06-11T16:00:32.487646+0000","last_fullsized":"2024-06-11T15:59:56.400903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:17:00.768242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255465,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":89,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":89}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":112,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-06-11T16:00:37.315474+0000","last_change":"2024-06-11T16:00:06.745478+0000","last_active":"2024-06-11T16:00:37.315474+0000","last_peered":"2024-06-11T16:00:37.315474+0000","last_clean":"2024-06-11T16:00:37.315474+0000","last_became_active":"2024-06-11T16:00:06.729808+0000","last_became_peered":"2024-06-11T16:00:06.729808+0000","last_unstale":"2024-06-11T16:00:37.315474+0000","last_undegraded":"2024-06-11T16:00:37.315474+0000","last_fullsized":"2024-06-11T16:00:37.315474+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:19.971127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":25337984,"num_objects":4687,"num_object_clones":0,"num_object_copies":9374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":792,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4710,"num_write_kb":27541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64180224,"data_stored":44326986,"data_compressed":3078313,"data_compressed_allocated":3698688,"data_compressed_original":8851456,"omap_allocated":0,"internal_metadata":0},"log_size":4717,"ondisk_log_size":4717,"up":118,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":17158723,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":141,"num_write_kb":17108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":652,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5439488,"data_stored":30129674,"data_compressed":4297458,"data_compressed_allocated":5111808,"data_compressed_original":29876224,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":56,"acting":56,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":15,"acting":15,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":30957,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":722699,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57468,"kb_used_data":30448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94314372,"statfs":{"total":96636764160,"available":96577916928,"internally_reserved":0,"allocated":31178752,"data_stored":35977525,"data_compressed":3603388,"data_compressed_allocated":4329472,"data_compressed_original":20963328,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61316,"kb_used_data":34300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310524,"statfs":{"total":96636764160,"available":96573976576,"internally_reserved":0,"allocated":35123200,"data_stored":36129247,"data_compressed":2969158,"data_compressed_allocated":3563520,"data_compressed_original":16842752,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2232320,"data_stored":12963635,"data_compressed":1825376,"data_compressed_allocated":2166784,"data_compressed_original":12914688,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3170304,"data_stored":17158689,"data_compressed":2472082,"data_compressed_allocated":2945024,"data_compressed_original":16961536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34660352,"data_stored":24457808,"data_compressed":1588649,"data_compressed_allocated":1904640,"data_compressed_original":4452352,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29519872,"data_stored":19869178,"data_compressed":1489664,"data_compressed_allocated":1794048,"data_compressed_original":4399104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:00:41.679 INFO:tasks.thrashosds.thrasher:Setting 4.2f to [0, 2, 1] 2024-06-11T16:00:41.679 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2f', '0', '2', '1'] 2024-06-11T16:00:41.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2f 0 2 1 2024-06-11T16:00:41.698 INFO:tasks.workunit.client.0.smithi089.stdout:autoheader 2024-06-11T16:00:41.724 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:41.725+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:41.730 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:41.730 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:41.730 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:41.731 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:41.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:41.739 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:41.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:41.826+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:41.871 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:41.872 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:41.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T16:00:41.885 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:41.885 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:41.890 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:41.891 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:41.891 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:41.894 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:41.896 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:41.897 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:41.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:41.927+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:41.998 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:41.998 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:42.020 INFO:teuthology.orchestra.run.smithi089.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-06-11T16:00:42.026 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-06-11T16:00:42.026 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-06-11T16:00:42.027 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.026+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.052 INFO:tasks.workunit.client.0.smithi089.stdout:autoconf 2024-06-11T16:00:42.115 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.115 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.124 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:42.127 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.128+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.227 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.229+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.229 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.229 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.238 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:42.266 INFO:tasks.workunit.client.0.smithi089.stdout:./configure \ 2024-06-11T16:00:42.266 INFO:tasks.workunit.client.0.smithi089.stdout: --libexecdir=/usr/lib \ 2024-06-11T16:00:42.266 INFO:tasks.workunit.client.0.smithi089.stdout: --exec_prefix=/var/lib 2024-06-11T16:00:42.329 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.329+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.358 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.358 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.367 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:42.414 INFO:tasks.workunit.client.0.smithi089.stdout:checking build system type... x86_64-pc-linux-gnu 2024-06-11T16:00:42.414 INFO:tasks.workunit.client.0.smithi089.stdout:checking host system type... x86_64-pc-linux-gnu 2024-06-11T16:00:42.415 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to print strings... printf 2024-06-11T16:00:42.416 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gcc... gcc 2024-06-11T16:00:42.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-06-11T16:00:42.429 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.430+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.473 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.473 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.482 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:42.487 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether the C compiler works... yes 2024-06-11T16:00:42.487 INFO:tasks.workunit.client.0.smithi089.stdout:checking for C compiler default output file name... a.out 2024-06-11T16:00:42.529 INFO:tasks.workunit.client.0.smithi089.stdout:checking for suffix of executables... 2024-06-11T16:00:42.567 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.568+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.573 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether we are cross compiling... no 2024-06-11T16:00:42.601 INFO:tasks.workunit.client.0.smithi089.stdout:checking for suffix of object files... o 2024-06-11T16:00:42.625 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether we are using the GNU C compiler... yes 2024-06-11T16:00:42.630 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.630 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.631 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.631+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.639 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:42.648 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether gcc accepts -g... yes 2024-06-11T16:00:42.724 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-11T16:00:42.728 INFO:tasks.workunit.client.0.smithi089.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-06-11T16:00:42.731 INFO:tasks.workunit.client.0.smithi089.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-06-11T16:00:42.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:42.732+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:42.732 INFO:tasks.workunit.client.0.smithi089.stdout:checking for egrep... /usr/bin/grep -E 2024-06-11T16:00:42.733 INFO:tasks.workunit.client.0.smithi089.stdout:checking for fgrep... /usr/bin/grep -F 2024-06-11T16:00:42.737 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ld used by gcc... /usr/bin/ld 2024-06-11T16:00:42.739 INFO:tasks.workunit.client.0.smithi089.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-06-11T16:00:42.757 INFO:tasks.workunit.client.0.smithi089.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-06-11T16:00:42.786 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.786 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:42.832 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.833+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:42.857 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T16:00:42.902 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:42.902 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:42.911 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:42.933 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:42.934+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.015 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.015 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:43.034 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:43.035+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.129 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.129 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:43.135+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:43.139 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:43.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:43.237+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:43.256 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.256 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.265 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:43.337 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:43.338+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.371 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.380 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:43.464 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:43.465+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.525 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:43.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:43.578+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:43.639 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:43.640+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.641 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.641 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.649 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:43.686 INFO:tasks.workunit.client.0.smithi089.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-06-11T16:00:43.686 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether ln -s works... yes 2024-06-11T16:00:43.702 INFO:tasks.workunit.client.0.smithi089.stdout:checking the maximum length of command line arguments... 1572864 2024-06-11T16:00:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-06-11T16:00:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-06-11T16:00:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-06-11T16:00:43.706 INFO:tasks.workunit.client.0.smithi089.stdout:checking for objdump... objdump 2024-06-11T16:00:43.707 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to recognize dependent libraries... pass_all 2024-06-11T16:00:43.708 INFO:tasks.workunit.client.0.smithi089.stdout:checking for dlltool... no 2024-06-11T16:00:43.708 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-06-11T16:00:43.709 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ar... ar 2024-06-11T16:00:43.740 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:43.740+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:43.797 INFO:tasks.workunit.client.0.smithi089.stdout:checking for archiver @FILE support... @ 2024-06-11T16:00:43.797 INFO:tasks.workunit.client.0.smithi089.stdout:checking for strip... strip 2024-06-11T16:00:43.798 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.798 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.798 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ranlib... ranlib 2024-06-11T16:00:43.798 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gawk... gawk 2024-06-11T16:00:43.807 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:43.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:43.851+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:43.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:43.904 INFO:tasks.workunit.client.0.smithi089.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-06-11T16:00:43.906 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sysroot... no 2024-06-11T16:00:43.915 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:43.915 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:43.915 INFO:tasks.workunit.client.0.smithi089.stdout:checking for a working dd... /usr/bin/dd 2024-06-11T16:00:43.923 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-06-11T16:00:43.924 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:43.946 INFO:tasks.workunit.client.0.smithi089.stdout:checking for mt... no 2024-06-11T16:00:43.953 INFO:tasks.workunit.client.0.smithi089.stdout:checking if : is a manifest tool... no 2024-06-11T16:00:43.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:43.966+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:44.019 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to run the C preprocessor... gcc -E 2024-06-11T16:00:44.027 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:44.027 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:6256 4.34 4:2fe1df61:::10000001a9a.00000000:head [write 0~2766 in=2766b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:44.032960+0000", 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00079758900000000002, 2024-06-11T16:00:44.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00081639099999999997, 2024-06-11T16:00:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "waiting for sub ops", 2024-06-11T16:00:44.033 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 6256 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032960+0000", 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032960+0000", 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032960+0000", 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7400000000000002e-07 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032965+0000", 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4109999999999998e-06 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032976+0000", 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0954e-05 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.032981+0000", 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3040000000000004e-06 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.033027+0000", 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6264999999999998e-05 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.033118+0000", 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0404999999999999e-05 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:44.033191+0000", 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2866000000000003e-05 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.037 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-06-11T16:00:44.038 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 1 2024-06-11T16:00:44.038 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:44.041 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:44.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:44.043+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:44.046 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:44.047 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:44.047 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:44.050 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:44.050 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:44.143 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.144+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.148 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:44.148 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:44.148 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:44.148 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:44.148 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:44.157 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:44.196 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ANSI C header files... yes 2024-06-11T16:00:44.227 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/types.h... yes 2024-06-11T16:00:44.244 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.245+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.263 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/stat.h... yes 2024-06-11T16:00:44.302 INFO:tasks.workunit.client.0.smithi089.stdout:checking for stdlib.h... yes 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.306 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.046490817, 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.309 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:44.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:44.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:44.312 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0464654549999999, 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:44.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:44.315 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:44.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0460815189999999, 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.318 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.045970627, 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:44.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:44.329 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.045451425, 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:44.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:44.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.045153896, 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:44.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0434869529999999, 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0430619669999999, 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:44.346 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:44.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:44.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.351 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.042869337, 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:44.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:44.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0424765169999999, 2024-06-11T16:00:44.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:44.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:44.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.041963424, 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:44.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:44.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.039327637, 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:44.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:44.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:44.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.374 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0393011369999998, 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:44.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0387079730000002, 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.380 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:44.385 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0383906039999999, 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:44.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:44.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:44.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:44.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0379425640000002, 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:44.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:44.396 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0379071359999998, 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:44.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:44.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.0378147680000001, 2024-06-11T16:00:44.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:44.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.406 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.037796589, 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:44.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:44.412 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 3.03774999, 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:44.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:44.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:44.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:44.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:44.418 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:checking for string.h... yes 2024-06-11T16:00:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:checking for memory.h... yes 2024-06-11T16:00:44.420 INFO:tasks.workunit.client.0.smithi089.stdout:checking for strings.h... yes 2024-06-11T16:00:44.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:44.421 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.420+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.456 INFO:tasks.workunit.client.0.smithi089.stdout:checking for inttypes.h... yes 2024-06-11T16:00:44.494 INFO:tasks.workunit.client.0.smithi089.stdout:checking for stdint.h... yes 2024-06-11T16:00:44.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:44.521+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:44.527 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:44.527 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:44.527 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:44.527 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:44.534 INFO:tasks.workunit.client.0.smithi089.stdout:checking for unistd.h... yes 2024-06-11T16:00:44.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:44.580 INFO:tasks.workunit.client.0.smithi089.stdout:checking for dlfcn.h... yes 2024-06-11T16:00:44.585 INFO:tasks.workunit.client.0.smithi089.stdout:checking for objdir... .libs 2024-06-11T16:00:44.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:44.622+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:44.684 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:44.684 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:44.684 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:44.684 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:44.684 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:44.685 INFO:tasks.workunit.client.0.smithi089.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-06-11T16:00:44.685 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-06-11T16:00:44.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:44.712 INFO:tasks.workunit.client.0.smithi089.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-06-11T16:00:44.722 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.723+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.762 INFO:tasks.workunit.client.0.smithi089.stdout:checking if gcc static flag -static works... no 2024-06-11T16:00:44.806 INFO:tasks.workunit.client.0.smithi089.stdout:checking if gcc supports -c -o file.o... yes 2024-06-11T16:00:44.806 INFO:tasks.workunit.client.0.smithi089.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-06-11T16:00:44.813 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-06-11T16:00:44.822 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.823+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.841 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:44.841 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:44.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:44.841 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.651933696, 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:44.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:44.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 12.644975933, 2024-06-11T16:00:44.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:44.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:44.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5744203959999998, 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:44.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:44.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:44.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:44.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5743742130000005, 2024-06-11T16:00:44.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:44.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5743559879999998, 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.861 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5743230720000003, 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:44.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:44.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5743010359999996, 2024-06-11T16:00:44.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:44.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:44.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5741915469999999, 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:44.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:44.879 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5741433699999998, 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:44.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:44.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5739459409999998, 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:44.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:44.888 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5739145849999998, 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:44.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5738876719999997, 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:44.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.899 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5737543939999998, 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:44.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5737254109999999, 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.904 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:44.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5736879869999996, 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:44.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:44.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:44.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:44.913 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5732262769999998, 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:44.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:44.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5724850669999997, 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.918 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5724401590000001, 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.923 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:44.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.927 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5720394640000004, 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:44.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:44.932 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.5719125080000005, 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:44.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:44.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:44.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:44.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:44.937 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:44.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T16:00:44.940 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether -lc should be explicitly linked in... no 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking how to hardcode library paths into programs... immediate 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether stripping libraries is possible... yes 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking if libtool supports shared libraries... yes 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether to build shared libraries... yes 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether to build static libraries... yes 2024-06-11T16:00:44.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gcc... (cached) gcc 2024-06-11T16:00:44.942 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:44.940+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:44.964 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-11T16:00:44.964 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-11T16:00:44.965 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-11T16:00:44.965 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gmake... /usr/bin/gmake 2024-06-11T16:00:44.966 INFO:tasks.workunit.client.0.smithi089.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-06-11T16:00:44.966 INFO:tasks.workunit.client.0.smithi089.stdout:checking for tar... /bin/tar 2024-06-11T16:00:44.966 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gzip... /bin/gzip 2024-06-11T16:00:44.992 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether gcc -MM is supported... yes 2024-06-11T16:00:44.993 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sort... /bin/sort 2024-06-11T16:00:44.993 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether ln -s works... yes 2024-06-11T16:00:44.993 INFO:tasks.workunit.client.0.smithi089.stdout:checking for rpm... /bin/rpm 2024-06-11T16:00:44.997 INFO:tasks.workunit.client.0.smithi089.stdout:checking for rpmbuild... no 2024-06-11T16:00:44.997 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ANSI C header files... (cached) yes 2024-06-11T16:00:45.035 INFO:tasks.workunit.client.0.smithi089.stdout:checking assert.h usability... yes 2024-06-11T16:00:45.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:45.040+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(client.14414.0:6350 4.1 4:81fd60c9:::10000001af3.00000000:head [write 0~1809 in=1809b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:45.048285+0000", 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.00019604600000000001, 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000215221, 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:45.047 INFO:teuthology.orchestra.run.smithi129.stdout: "client_info": { 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "client": "client.14414", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "client_addr": "192.168.0.1:0/775289756", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "tid": 6350 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048285+0000", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048285+0000", 2024-06-11T16:00:45.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048285+0000", 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7000000000000004e-07 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048290+0000", 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3229999999999999e-06 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048300+0000", 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0607e-05 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048307+0000", 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0230000000000004e-06 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048364+0000", 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6915e-05 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:45.048446+0000", 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1688999999999997e-05 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 1 2024-06-11T16:00:45.051 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:45.052 INFO:tasks.workunit.client.0.smithi089.stdout:checking assert.h presence... yes 2024-06-11T16:00:45.052 INFO:tasks.workunit.client.0.smithi089.stdout:checking for assert.h... yes 2024-06-11T16:00:45.056 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:45.093 INFO:tasks.workunit.client.0.smithi089.stdout:checking bstring.h usability... no 2024-06-11T16:00:45.114 INFO:tasks.workunit.client.0.smithi089.stdout:checking bstring.h presence... no 2024-06-11T16:00:45.115 INFO:tasks.workunit.client.0.smithi089.stdout:checking for bstring.h... no 2024-06-11T16:00:45.140 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.141+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.149 INFO:tasks.workunit.client.0.smithi089.stdout:checking libgen.h usability... yes 2024-06-11T16:00:45.162 INFO:tasks.workunit.client.0.smithi089.stdout:checking libgen.h presence... yes 2024-06-11T16:00:45.162 INFO:tasks.workunit.client.0.smithi089.stdout:checking for libgen.h... yes 2024-06-11T16:00:45.166 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:45.166 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:45.166 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:45.166 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:45.166 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:45.175 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:45.205 INFO:tasks.workunit.client.0.smithi089.stdout:checking dirent.h usability... yes 2024-06-11T16:00:45.219 INFO:tasks.workunit.client.0.smithi089.stdout:checking dirent.h presence... yes 2024-06-11T16:00:45.220 INFO:tasks.workunit.client.0.smithi089.stdout:checking for dirent.h... yes 2024-06-11T16:00:45.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:45.243+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:45.261 INFO:tasks.workunit.client.0.smithi089.stdout:checking errno.h usability... yes 2024-06-11T16:00:45.274 INFO:tasks.workunit.client.0.smithi089.stdout:checking errno.h presence... yes 2024-06-11T16:00:45.274 INFO:tasks.workunit.client.0.smithi089.stdout:checking for errno.h... yes 2024-06-11T16:00:45.315 INFO:tasks.workunit.client.0.smithi089.stdout:checking malloc.h usability... yes 2024-06-11T16:00:45.324 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:45.324 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:45.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:45.324 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.064840802, 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.325 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:45.326 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.330 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0648154400000003, 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:45.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.332 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:45.335 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0644315039999999, 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:45.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:45.341 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0643206120000004, 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:45.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.344 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:45.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.347 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0638014099999999, 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:45.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.350 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.354 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.354 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:45.354 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0635038809999999, 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.355 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:45.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:45.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0618369379999999, 2024-06-11T16:00:45.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:45.361 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.361 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.361 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.361 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:45.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:45.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0614119520000003, 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.367 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:45.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:45.371 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0612193220000004, 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.373 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:45.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:45.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:45.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:45.377 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0608265020000003, 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:45.380 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:45.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:45.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0603134089999999, 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:45.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:45.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0576776219999999, 2024-06-11T16:00:45.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:45.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.392 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.393 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0576511220000002, 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:45.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:45.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.399 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0570579579999997, 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:45.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:45.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0567405890000003, 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.405 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:45.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.409 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0562925490000001, 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.411 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:45.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:45.416 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0562571209999998, 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.056164753, 2024-06-11T16:00:45.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:45.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:45.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0561465739999996, 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.427 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:45.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:45.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.432 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.0560999750000004, 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:45.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:45.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:45.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:45.438 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:45.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:45.441 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.440+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.441 INFO:tasks.workunit.client.0.smithi089.stdout:checking malloc.h presence... yes 2024-06-11T16:00:45.442 INFO:tasks.workunit.client.0.smithi089.stdout:checking for malloc.h... yes 2024-06-11T16:00:45.442 INFO:tasks.workunit.client.0.smithi089.stdout:checking uuid.h usability... no 2024-06-11T16:00:45.442 INFO:tasks.workunit.client.0.smithi089.stdout:checking uuid.h presence... no 2024-06-11T16:00:45.442 INFO:tasks.workunit.client.0.smithi089.stdout:checking for uuid.h... no 2024-06-11T16:00:45.442 INFO:tasks.workunit.client.0.smithi089.stdout:checking uuid/uuid.h usability... yes 2024-06-11T16:00:45.455 INFO:tasks.workunit.client.0.smithi089.stdout:checking uuid/uuid.h presence... yes 2024-06-11T16:00:45.455 INFO:tasks.workunit.client.0.smithi089.stdout:checking for uuid/uuid.h... yes 2024-06-11T16:00:45.498 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/uuid.h usability... no 2024-06-11T16:00:45.518 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/uuid.h presence... no 2024-06-11T16:00:45.519 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/uuid.h... no 2024-06-11T16:00:45.540 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.541+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.549 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:45.549 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:45.549 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:45.549 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:45.554 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/file.h usability... yes 2024-06-11T16:00:45.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:45.568 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/file.h presence... yes 2024-06-11T16:00:45.568 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/file.h... yes 2024-06-11T16:00:45.609 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fcntl.h usability... yes 2024-06-11T16:00:45.623 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fcntl.h presence... yes 2024-06-11T16:00:45.623 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/fcntl.h... yes 2024-06-11T16:00:45.641 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.641+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.664 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:45.664 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:45.664 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:45.664 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:45.664 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:45.665 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/syssgi.h usability... no 2024-06-11T16:00:45.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:45.686 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/syssgi.h presence... no 2024-06-11T16:00:45.686 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/syssgi.h... no 2024-06-11T16:00:45.741 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.742+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.751 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/param.h usability... yes 2024-06-11T16:00:45.767 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/param.h presence... yes 2024-06-11T16:00:45.768 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/param.h... yes 2024-06-11T16:00:45.779 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:45.779 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.590259862, 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:45.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.784 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.583302099000001, 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:45.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5127465620000002, 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:45.790 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.791 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.792 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.512700379, 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.794 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.795 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.796 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:45.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:45.798 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5126821540000002, 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.799 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.800 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.801 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.802 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5126492379999998, 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.804 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.805 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.806 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.807 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.512627202, 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.808 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.809 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.810 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:45.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.812 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5125177130000003, 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.813 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:45.814 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.815 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:45.816 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5124695360000002, 2024-06-11T16:00:45.817 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.818 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.819 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:45.820 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5122721070000003, 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.822 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:45.823 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.824 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.825 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5122407510000002, 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:45.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:45.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5122138380000001, 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.831 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.835 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5120805600000002, 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:45.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.840 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5120515770000003, 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.841 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:45.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:45.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:45.845 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.512014153, 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:45.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5115524430000002, 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.850 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:45.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:45.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.854 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5108112330000001, 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:45.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.859 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5107663249999996, 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:45.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:45.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:45.864 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.5103656299999999, 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:45.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:45.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.510238674, 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:45.869 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:45.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:45.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:45.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:45.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:45.874 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:45.876 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:45.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/stat.h... (cached) yes 2024-06-11T16:00:45.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/statvfs.h usability... yes 2024-06-11T16:00:45.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/statvfs.h presence... yes 2024-06-11T16:00:45.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/statvfs.h... yes 2024-06-11T16:00:45.878 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T16:00:45.879 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:45.876+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:45.887 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/time.h usability... yes 2024-06-11T16:00:45.900 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/time.h presence... yes 2024-06-11T16:00:45.900 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/time.h... yes 2024-06-11T16:00:45.941 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/ioctl.h usability... yes 2024-06-11T16:00:45.954 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/ioctl.h presence... yes 2024-06-11T16:00:45.954 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/ioctl.h... yes 2024-06-11T16:00:45.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:45.977+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:45.985 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:45.985 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:45.986 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:45.986 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:45.994 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:46.001 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/wait.h usability... yes 2024-06-11T16:00:46.016 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/wait.h presence... yes 2024-06-11T16:00:46.016 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/wait.h... yes 2024-06-11T16:00:46.026 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/types.h... (cached) yes 2024-06-11T16:00:46.034 INFO:tasks.workunit.client.0.smithi089.stdout:checking for strings.h... (cached) yes 2024-06-11T16:00:46.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:46.076 INFO:tasks.workunit.client.0.smithi089.stdout:checking err.h usability... yes 2024-06-11T16:00:46.077 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.077+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.090 INFO:tasks.workunit.client.0.smithi089.stdout:checking err.h presence... yes 2024-06-11T16:00:46.090 INFO:tasks.workunit.client.0.smithi089.stdout:checking for err.h... yes 2024-06-11T16:00:46.101 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:46.101 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:46.101 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:46.101 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:46.101 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:46.110 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:46.133 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/falloc.h usability... yes 2024-06-11T16:00:46.146 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/falloc.h presence... yes 2024-06-11T16:00:46.146 INFO:tasks.workunit.client.0.smithi089.stdout:checking for linux/falloc.h... yes 2024-06-11T16:00:46.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:46.178+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:46.182 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:46.182 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:46.191 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-06-11T16:00:46.202 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:46.202 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:46.202 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:46.205 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:46.206 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:46.213 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-06-11T16:00:46.213 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/fs/xfs_fsops.h... no 2024-06-11T16:00:46.250 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fs/xfs_itable.h usability... no 2024-06-11T16:00:46.262 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.262 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.274 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:46.278 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.278+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/fs/xfs_itable.h presence... no 2024-06-11T16:00:46.281 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/fs/xfs_itable.h... no 2024-06-11T16:00:46.318 INFO:tasks.workunit.client.0.smithi089.stdout:checking xfs/platform_defs.h usability... no 2024-06-11T16:00:46.339 INFO:tasks.workunit.client.0.smithi089.stdout:checking xfs/platform_defs.h presence... no 2024-06-11T16:00:46.339 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/platform_defs.h... no 2024-06-11T16:00:46.378 INFO:tasks.workunit.client.0.smithi089.stdout:checking btrfs/ioctl.h usability... no 2024-06-11T16:00:46.378 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.379+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.382 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.382 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.391 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:46.398 INFO:tasks.workunit.client.0.smithi089.stdout:checking btrfs/ioctl.h presence... no 2024-06-11T16:00:46.398 INFO:tasks.workunit.client.0.smithi089.stdout:checking for btrfs/ioctl.h... no 2024-06-11T16:00:46.437 INFO:tasks.workunit.client.0.smithi089.stdout:checking cifs/ioctl.h usability... no 2024-06-11T16:00:46.457 INFO:tasks.workunit.client.0.smithi089.stdout:checking cifs/ioctl.h presence... no 2024-06-11T16:00:46.457 INFO:tasks.workunit.client.0.smithi089.stdout:checking for cifs/ioctl.h... no 2024-06-11T16:00:46.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:46.480+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.497 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.502 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/mman.h usability... yes 2024-06-11T16:00:46.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:46.516 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/mman.h presence... yes 2024-06-11T16:00:46.516 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/mman.h... yes 2024-06-11T16:00:46.544 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/xfs_log_format.h... no 2024-06-11T16:00:46.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:46.590+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:46.597 INFO:tasks.workunit.client.0.smithi089.stdout:checking for uuid_compare... no 2024-06-11T16:00:46.643 INFO:tasks.workunit.client.0.smithi089.stdout:checking for uuid_compare in -luuid... yes 2024-06-11T16:00:46.652 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.652 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.661 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:46.697 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/xfs.h... yes 2024-06-11T16:00:46.706 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.707+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.720 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/libxfs.h... no 2024-06-11T16:00:46.745 INFO:tasks.workunit.client.0.smithi089.stdout:checking whether xlog_assign_lsn is declared... no 2024-06-11T16:00:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.778 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:46.782 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/xqm.h... yes 2024-06-11T16:00:46.819 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.820+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.843 INFO:tasks.workunit.client.0.smithi089.stdout:checking xfsctl from xfs/xfs.h... ok 2024-06-11T16:00:46.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking xfs/handle.h usability... yes 2024-06-11T16:00:46.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:46.882+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:46.889 INFO:tasks.workunit.client.0.smithi089.stdout:checking xfs/handle.h presence... yes 2024-06-11T16:00:46.889 INFO:tasks.workunit.client.0.smithi089.stdout:checking for xfs/handle.h... yes 2024-06-11T16:00:46.925 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:46.925 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:46.933 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:46.944 INFO:tasks.workunit.client.0.smithi089.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-06-11T16:00:46.983 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:46.984+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:46.994 INFO:tasks.workunit.client.0.smithi089.stdout:checking attr/attributes.h usability... yes 2024-06-11T16:00:47.007 INFO:tasks.workunit.client.0.smithi089.stdout:checking attr/attributes.h presence... yes 2024-06-11T16:00:47.008 INFO:tasks.workunit.client.0.smithi089.stdout:checking for attr/attributes.h... yes 2024-06-11T16:00:47.027 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-06-11T16:00:47.027 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-06-11T16:00:47.028 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-06-11T16:00:47.028 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T16:00:47.028 INFO:teuthology.orchestra.console.smithi171:Power on 2024-06-11T16:00:47.028 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-06-11T16:00:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.050 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:47.051 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On 2024-06-11T16:00:47.051 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-06-11T16:00:47.060 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/attributes.h usability... no 2024-06-11T16:00:47.071 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/attributes.h presence... no 2024-06-11T16:00:47.072 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/attributes.h... no 2024-06-11T16:00:47.075 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-06-11T16:00:47.090 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:47.091+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:47.133 INFO:tasks.workunit.client.0.smithi089.stdout:checking for attr_list in -lattr... yes 2024-06-11T16:00:47.166 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.166 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.175 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:47.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.219+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.223 INFO:tasks.workunit.client.0.smithi089.stdout:checking for attr_set in -lattr... yes 2024-06-11T16:00:47.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.286+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.287 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.287 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.289 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/acl.h usability... yes 2024-06-11T16:00:47.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:47.304 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/acl.h presence... yes 2024-06-11T16:00:47.304 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/acl.h... yes 2024-06-11T16:00:47.365 INFO:tasks.workunit.client.0.smithi089.stdout:checking acl/libacl.h usability... yes 2024-06-11T16:00:47.379 INFO:tasks.workunit.client.0.smithi089.stdout:checking acl/libacl.h presence... yes 2024-06-11T16:00:47.379 INFO:tasks.workunit.client.0.smithi089.stdout:checking for acl/libacl.h... yes 2024-06-11T16:00:47.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.386+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.442 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.442 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.450 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:47.465 INFO:tasks.workunit.client.0.smithi089.stdout:checking for acl_init in -lacl... yes 2024-06-11T16:00:47.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.492+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.516 INFO:tasks.workunit.client.0.smithi089.stdout:checking gdbm-ndbm.h usability... no 2024-06-11T16:00:47.537 INFO:tasks.workunit.client.0.smithi089.stdout:checking gdbm-ndbm.h presence... no 2024-06-11T16:00:47.537 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gdbm-ndbm.h... no 2024-06-11T16:00:47.558 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.558 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.567 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:47.608 INFO:tasks.workunit.client.0.smithi089.stdout:checking gdbm/ndbm.h usability... no 2024-06-11T16:00:47.611 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:47.612+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:47.628 INFO:tasks.workunit.client.0.smithi089.stdout:checking gdbm/ndbm.h presence... no 2024-06-11T16:00:47.628 INFO:tasks.workunit.client.0.smithi089.stdout:checking for gdbm/ndbm.h... no 2024-06-11T16:00:47.668 INFO:tasks.workunit.client.0.smithi089.stdout:checking ndbm.h usability... no 2024-06-11T16:00:47.674 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.675 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.684 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:47.688 INFO:tasks.workunit.client.0.smithi089.stdout:checking ndbm.h presence... no 2024-06-11T16:00:47.689 INFO:tasks.workunit.client.0.smithi089.stdout:checking for ndbm.h... no 2024-06-11T16:00:47.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.689+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.730 INFO:tasks.workunit.client.0.smithi089.stdout:checking libaio.h usability... yes 2024-06-11T16:00:47.745 INFO:tasks.workunit.client.0.smithi089.stdout:checking libaio.h presence... yes 2024-06-11T16:00:47.745 INFO:tasks.workunit.client.0.smithi089.stdout:checking for libaio.h... yes 2024-06-11T16:00:47.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.791+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout:checking for dm_make_handle in -ldm... no 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout:WARNING: could not find a valid DMAPI base library. 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout:If you want DMAPI support please install the data migration 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout:from the dmapi source. 2024-06-11T16:00:47.812 INFO:tasks.workunit.client.0.smithi089.stdout: 2024-06-11T16:00:47.829 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.829 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.838 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:47.864 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/fiemap.h usability... yes 2024-06-11T16:00:47.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/fiemap.h presence... yes 2024-06-11T16:00:47.877 INFO:tasks.workunit.client.0.smithi089.stdout:checking for linux/fiemap.h... yes 2024-06-11T16:00:47.878 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:00:47.891 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:47.892+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:47.945 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:47.945 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:47.954 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:47.960 INFO:tasks.workunit.client.0.smithi089.stdout:checking for fallocate... yes 2024-06-11T16:00:47.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:47.998+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:48.059 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:48.059 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:48.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:48.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:48.109+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:48.118 INFO:tasks.workunit.client.0.smithi089.stdout:checking for open_by_handle_at... yes 2024-06-11T16:00:48.190 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/prctl.h usability... yes 2024-06-11T16:00:48.193 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.193+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:48.202 INFO:tasks.workunit.client.0.smithi089.stdout:checking sys/prctl.h presence... yes 2024-06-11T16:00:48.202 INFO:tasks.workunit.client.0.smithi089.stdout:checking for sys/prctl.h... yes 2024-06-11T16:00:48.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:48.213 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:48.213 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:48.223 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:48.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-06-11T16:00:48.236 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/fs.h usability... yes 2024-06-11T16:00:48.249 INFO:tasks.workunit.client.0.smithi089.stdout:checking linux/fs.h presence... yes 2024-06-11T16:00:48.249 INFO:tasks.workunit.client.0.smithi089.stdout:checking for linux/fs.h... yes 2024-06-11T16:00:48.287 INFO:tasks.workunit.client.0.smithi089.stdout:checking btrfsutil.h usability... no 2024-06-11T16:00:48.294 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.295+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:48.308 INFO:tasks.workunit.client.0.smithi089.stdout:checking btrfsutil.h presence... no 2024-06-11T16:00:48.308 INFO:tasks.workunit.client.0.smithi089.stdout:checking for btrfsutil.h... no 2024-06-11T16:00:48.335 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:48.335 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:48.336 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:48.336 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:48.336 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:48.337 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:48.345 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:48.353 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:48.354 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:48.357 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:48.357 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:48.385 INFO:tasks.workunit.client.0.smithi089.stdout:checking for copy_file_range... yes 2024-06-11T16:00:48.430 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.431+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:48.435 INFO:tasks.workunit.client.0.smithi089.stdout:checking for renameat2... yes 2024-06-11T16:00:48.454 INFO:tasks.workunit.client.0.smithi089.stdout:configure: creating ./config.status 2024-06-11T16:00:48.492 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:48.492 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:48.492 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:48.492 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:48.492 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:48.495 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.496+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:48.501 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:48.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:48.598+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:48.649 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:48.649 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3896531080000001, 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.650 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:48.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:48.655 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3896277460000004, 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:48.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:48.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.661 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.38924381, 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:48.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:48.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:48.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:48.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.668 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3891329179999996, 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.674 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3886137160000001, 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:48.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:48.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.388316187, 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:48.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.686 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.386649244, 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:48.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:48.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:48.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3862242580000004, 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:48.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:48.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.697 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3860316279999996, 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:48.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:48.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3856388080000004, 2024-06-11T16:00:48.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:48.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:48.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.385125715, 2024-06-11T16:00:48.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:48.715 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.382489928, 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:48.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3824634280000003, 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.721 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:48.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.726 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3818702639999998, 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:48.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:48.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:48.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3815528950000004, 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:48.732 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:48.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:48.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3811048550000002, 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.738 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:48.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:48.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3810694269999999, 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.744 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:48.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:48.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3809770590000001, 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.749 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.750 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:48.751 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.752 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:48.753 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.754 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3809588799999997, 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.755 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:48.756 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:48.757 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.758 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.759 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.760 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 7.3809122809999996, 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.761 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:48.762 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:48.763 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:48.764 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.765 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.766 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:48.767 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:48.767 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:48.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:48.768 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.769+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:48.776 INFO:tasks.workunit.client.0.smithi089.stdout:config.status: creating include/builddefs 2024-06-11T16:00:48.791 INFO:tasks.workunit.client.0.smithi089.stdout:config.status: creating include/config.h 2024-06-11T16:00:48.806 INFO:tasks.workunit.client.0.smithi089.stdout:config.status: executing libtool commands 2024-06-11T16:00:48.869 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:00:48.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:48.870+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:48.874 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:48.874 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:48.874 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:48.874 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:48.884 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:48.897 INFO:tasks.workunit.client.0.smithi089.stdout:Building lib 2024-06-11T16:00:48.898 INFO:tasks.workunit.client.0.smithi089.stdout:Building include 2024-06-11T16:00:48.898 INFO:tasks.workunit.client.0.smithi089.stdout:Building tests 2024-06-11T16:00:48.908 INFO:tasks.workunit.client.0.smithi089.stdout: [LTDEP] 2024-06-11T16:00:48.970 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:48.971+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:49.028 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:49.028 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:49.029 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:49.029 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:49.029 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:49.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:49.071 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:49.073+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:49.143 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:49.143 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:49.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:49.143 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.954271567999999, 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:49.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:49.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:49.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.947313805, 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:49.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8767582679999997, 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:49.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:49.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:49.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8767120849999994, 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:49.157 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:49.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:49.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8766938599999996, 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:49.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8766609439999993, 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:49.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:49.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8766389080000003, 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:49.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:49.175 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8765294190000006, 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:49.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:49.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8764812420000005, 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:49.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:49.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8762838130000006, 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.184 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:49.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:49.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:49.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8762524569999997, 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:49.188 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8762255440000004, 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.196 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8760922660000006, 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:49.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:49.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:49.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8760632830000006, 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:49.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:49.205 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8760258590000003, 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:49.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:49.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:49.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8755641490000006, 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:49.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:49.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:49.219 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8748229389999995, 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:49.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:49.223 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.874778031, 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:49.224 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:49.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.229 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8743773360000002, 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:49.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:49.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:49.234 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.8742503799999994, 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:49.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:49.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:49.239 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:49.241 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] dataascii.lo 2024-06-11T16:00:49.241 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] databin.lo 2024-06-11T16:00:49.241 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] datapid.lo 2024-06-11T16:00:49.241 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] file_lock.lo 2024-06-11T16:00:49.241 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:49.242 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:49.241+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:49.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:49.342+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:49.351 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:49.352 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:49.352 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:49.352 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:49.360 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:49.387 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] forker.lo 2024-06-11T16:00:49.396 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] pattern.lo 2024-06-11T16:00:49.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:49.443+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:49.455 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] open_flags.lo 2024-06-11T16:00:49.466 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:49.466 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:49.466 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:49.470 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] random_range.lo 2024-06-11T16:00:49.475 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:49.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:49.544+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:49.554 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] string_to_tokens.lo 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.583 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3235160710000002, 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:49.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:49.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3234907089999997, 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.589 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:49.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.594 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3231067729999992, 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:49.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:49.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3229958810000007, 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:49.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:49.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3224766789999993, 2024-06-11T16:00:49.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:49.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:49.611 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3221791500000002, 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:49.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.617 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3205122070000002, 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.618 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:49.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:49.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3200872209999996, 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.623 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:49.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:49.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3198945910000006, 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:49.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:49.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3195017710000005, 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.634 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:49.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:49.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.639 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3189886780000002, 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:49.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:49.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:49.645 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3163528909999993, 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:49.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3163263910000005, 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.651 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:49.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:49.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:49.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3157332270000008, 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:49.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:49.662 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3154158579999997, 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:49.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:49.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3149678179999995, 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.668 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:49.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:49.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:49.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3149323899999992, 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:49.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3148400220000003, 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:49.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:49.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:49.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3148218430000007, 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:49.684 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:49.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 8.3147752439999998, 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:49.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:49.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:49.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:49.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:49.695 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:49.697 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] str_to_bytes.lo 2024-06-11T16:00:49.697 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] tlibio.lo 2024-06-11T16:00:49.697 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] write_log.lo 2024-06-11T16:00:49.697 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:49.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:49.697+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:49.784 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] random.lo 2024-06-11T16:00:49.797 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:49.799+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:49.805 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:49.805 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:49.805 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:49.805 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:49.814 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:49.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:49.899+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:49.920 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:49.921 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:49.921 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:49.921 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:49.921 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:49.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:49.999 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:50.000+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:50.003 INFO:tasks.workunit.client.0.smithi089.stdout: [LD] 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.078 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.888684067, 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.881726304000001, 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.083 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:50.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:50.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8111707670000001, 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:50.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8111245839999999, 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:50.092 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:50.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8111063590000001, 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:50.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8110734429999997, 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:50.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:50.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:50.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8110514070000008, 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:50.110 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8109419179999993, 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:50.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:50.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8108937409999992, 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8106963119999993, 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8106649560000001, 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8106380430000009, 2024-06-11T16:00:50.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:50.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8105047649999992, 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:50.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:50.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8104757819999993, 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:50.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.142 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8104383580000007, 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:50.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:50.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8099766479999992, 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.147 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:50.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:50.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.809235438, 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:50.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:50.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8091905300000004, 2024-06-11T16:00:50.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:50.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:50.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8087898350000007, 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:50.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:50.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.8086628789999999, 2024-06-11T16:00:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:50.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:50.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:50.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:50.170 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:Building ltp 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:Building src 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:Building m4 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout:Building common 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout: [DEP] 2024-06-11T16:00:50.172 INFO:tasks.workunit.client.0.smithi089.stdout: [DEP] 2024-06-11T16:00:50.172 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:50.173 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:50.172+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:50.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.273+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.284 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:50.284 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:50.284 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:50.284 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:50.293 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:50.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:50.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.374+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.397 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:50.397 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:50.397 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:50.397 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:50.397 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:50.406 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:50.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.475+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.500 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:50.501 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:50.510 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:50.511 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:50.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:50.524 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:50.525 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:50.525 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:50.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:50.529 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:50.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.576+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.626 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] doio 2024-06-11T16:00:50.627 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fsstress 2024-06-11T16:00:50.627 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fsx 2024-06-11T16:00:50.628 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:50.628 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:50.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:50.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.678+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.777 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:50.778+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:50.782 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:50.782 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:50.791 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:50.872 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c: In function 'attr_list_path': 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~ 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:In file included from ../src/global.h:25, 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: from fsstress.c:12: 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~ 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c: In function 'attr_remove_path': 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~ 2024-06-11T16:00:50.873 INFO:tasks.workunit.client.0.smithi089.stderr:In file included from ../src/global.h:25, 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: from fsstress.c:12: 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~ 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c: In function 'attr_set_path': 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~ 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr:In file included from ../src/global.h:25, 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: from fsstress.c:12: 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-06-11T16:00:50.874 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~ 2024-06-11T16:00:50.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:50.878+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:50.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:00:50.886 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c: In function 'allocsp_f': 2024-06-11T16:00:50.888 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-11T16:00:50.888 INFO:tasks.workunit.client.0.smithi089.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-06-11T16:00:50.888 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~~ 2024-06-11T16:00:50.888 INFO:tasks.workunit.client.0.smithi089.stderr: | XFS_IOC_RESVSP64 2024-06-11T16:00:50.888 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-06-11T16:00:50.896 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:50.896 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:50.905 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:50.905 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c: In function 'freesp_f': 2024-06-11T16:00:50.906 INFO:tasks.workunit.client.0.smithi089.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-11T16:00:50.906 INFO:tasks.workunit.client.0.smithi089.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-06-11T16:00:50.906 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~ 2024-06-11T16:00:50.906 INFO:tasks.workunit.client.0.smithi089.stderr: | XFS_IOC_RESVSP64 2024-06-11T16:00:50.942 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[3]: *** [Makefile:46: fsstress] Error 1 2024-06-11T16:00:50.943 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-11T16:00:50.979 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:50.980+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:51.011 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.011 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.019 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:51.076 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-06-11T16:00:51.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.086+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:51.165 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.165 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.174 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:51.186 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-06-11T16:00:51.218 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:51.219+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:51.283 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.283 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.286 INFO:teuthology.orchestra.console.smithi171:Power on completed 2024-06-11T16:00:51.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.288+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:51.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr:doio.c: In function 'parse_cmdline': 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr: 3113 | fprintf(stderr, 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~ 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-06-11T16:00:51.373 INFO:tasks.workunit.client.0.smithi089.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:51.374 INFO:tasks.workunit.client.0.smithi089.stderr: 3115 | Prog, TagName, tok); 2024-06-11T16:00:51.374 INFO:tasks.workunit.client.0.smithi089.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:51.387 DEBUG:teuthology.orchestra.console.smithi171:Waiting for login prompt 2024-06-11T16:00:51.387 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi171 2024-06-11T16:00:51.398 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:51.389+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:51.399 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.399 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.407 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:51.410 INFO:tasks.workunit.client.0.smithi089.stderr:fsx.c: In function 'main': 2024-06-11T16:00:51.410 INFO:tasks.workunit.client.0.smithi089.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-06-11T16:00:51.410 INFO:tasks.workunit.client.0.smithi089.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-06-11T16:00:51.410 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:51.411 INFO:tasks.workunit.client.0.smithi089.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-06-11T16:00:51.411 INFO:tasks.workunit.client.0.smithi089.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-06-11T16:00:51.411 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:51.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.489+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:51.516 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.517 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.524 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-06-11T16:00:51.524 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-06-11T16:00:51.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:51.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.610+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:51.670 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.671 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.679 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:51.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.721+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:51.786 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.786 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.792 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:51.793+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:51.795 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:51.885 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:00:51.893 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:51.894+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:51.942 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:51.943 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:51.951 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:51.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:51.996+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.095 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:52.096+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:52.096 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:52.096 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:52.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:52.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:52.197+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.212 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:52.212 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:52.222 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:52.298 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:52.299+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:52.367 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:52.367 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:52.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:52.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:52.420+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.482 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:52.482 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:52.491 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:52.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:52.534 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:52.535+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:52.596 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:52.597 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:52.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:52.601+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.606 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:52.671 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:52.671 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:52.691 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:52.692 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:52.692 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:52.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:52.693 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:52.700 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:52.701+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:52.751 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:52.751 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:52.751 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:52.751 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:52.751 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:52.761 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:52.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:52.803+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:52.903+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:52.908 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:52.908 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.648847242, 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.909 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.910 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:52.911 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.912 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.913 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.914 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.64882188, 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.915 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:52.916 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.917 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.918 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.919 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.648437943999999, 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.920 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.921 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:52.922 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.923 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.924 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.925 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.648327051999999, 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.926 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.927 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.928 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:52.929 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.930 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.931 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.64780785, 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.932 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.933 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:52.934 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:52.935 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.936 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.937 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.647510321, 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.938 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.939 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:52.940 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:52.941 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.942 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.645843378, 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.943 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:52.944 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.945 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.946 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.947 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.948 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.645418392, 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.949 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:52.950 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:52.951 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.952 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.953 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.645225762000001, 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.954 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.955 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.956 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:52.957 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:52.958 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.963 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.964 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.644832942000001, 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:52.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.644319849, 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.970 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:52.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.975 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.641684061999999, 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.976 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:52.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:52.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.981 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.641657562000001, 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:52.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:52.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.641064397999999, 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.987 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:52.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:52.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.992 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640747029, 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:52.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:52.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:52.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640298989, 2024-06-11T16:00:52.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:53.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:53.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640263560999999, 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:53.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:53.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640171193, 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:53.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:53.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640153013999999, 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.014 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:53.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:53.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 11.640106415, 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:53.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.025 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:53.027 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:53.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.028+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.128+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.135 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:53.135 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:53.136 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:53.136 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:53.144 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:53.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.229+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.290 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:53.290 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:53.291 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:53.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:53.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.345+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.431+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.450 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:53.450 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:53.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:53.450 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.261301418999999, 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:53.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:53.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.254343656, 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:53.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183788119000001, 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:53.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183741936000001, 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.464 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:53.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183723711000001, 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:53.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183690795, 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:53.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183668759, 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:53.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:53.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.18355927, 2024-06-11T16:00:53.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:53.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:53.486 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183511093, 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:53.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183313664, 2024-06-11T16:00:53.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.495 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183282308000001, 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:53.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:53.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183255395, 2024-06-11T16:00:53.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:53.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183122117, 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:53.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:53.509 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.183093134, 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:53.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.18305571, 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:53.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:53.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.182594, 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.181852790000001, 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.522 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:53.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.181807881999999, 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:53.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.181407187, 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.531 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:53.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:53.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.181280231000001, 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:53.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:53.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:53.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:53.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:53.541 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:53.542 INFO:tasks.workunit.client.0.smithi089.stdout: [DEP] 2024-06-11T16:00:53.542 INFO:tasks.workunit.client.0.smithi089.stdout: [DEP] 2024-06-11T16:00:53.543 INFO:tasks.workunit.client.0.smithi089.stdout: [DEP] 2024-06-11T16:00:53.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:53.543+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:53.543 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:53.643 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:53.644+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:53.650 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:53.650 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:53.650 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:53.650 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:53.659 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:53.744 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:53.745+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:53.805 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:53.805 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:53.805 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:53.805 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:53.805 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:53.814 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:53.855 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:53.856+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:53.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-06-11T16:00:53.926 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] dirstress 2024-06-11T16:00:53.935 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fill 2024-06-11T16:00:53.935 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fill2 2024-06-11T16:00:53.938 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] getpagesize 2024-06-11T16:00:53.946 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:53.947+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1593 3.1d 3:bf8dcf43:::200.00000008:head [write 3913349~2256 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.702196174999999, 2024-06-11T16:00:53.962 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032585401999999999, 2024-06-11T16:00:53.963 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.963 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.963 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.963 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.963 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.964 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.964 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259412+0000", 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259413+0000", 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6700000000000003e-07 2024-06-11T16:00:53.965 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259419+0000", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000002e-06 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259427+0000", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3389999999999993e-06 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259431+0000", 2024-06-11T16:00:53.966 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0199999999999996e-06 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266014+0000", 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0065824960000000002 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266081+0000", 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7424999999999999e-05 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.967 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266168+0000", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6774000000000006e-05 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279033+0000", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012864595 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291906+0000", 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012872855000000001 2024-06-11T16:00:53.968 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291960+0000", 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.41e-05 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7700999999999997e-05 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.969 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1594 3.1d 3:bf8dcf43:::200.00000008:head [write 3915605~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.702170813, 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032704724999999997, 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.970 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259437+0000", 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259438+0000", 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9900000000000002e-07 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.971 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259443+0000", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3990000000000003e-06 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259451+0000", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6380000000000004e-06 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259454+0000", 2024-06-11T16:00:53.972 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7479999999999999e-06 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266421+0000", 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0069662750000000001 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266479+0000", 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8029999999999998e-05 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.973 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266581+0000", 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102211 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279037+0000", 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012456076 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.974 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292058+0000", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013020874 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292102+0000", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3869999999999998e-05 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292142+0000", 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0305000000000001e-05 2024-06-11T16:00:53.975 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1611 4.15 4:aa8b0fbc:::100000004ef.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.701786877, 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032316245, 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.976 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259821+0000", 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.977 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259822+0000", 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2099999999999997e-07 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259825+0000", 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7159999999999999e-06 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.978 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259831+0000", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7739999999999999e-06 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259836+0000", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6040000000000003e-06 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267203+0000", 2024-06-11T16:00:53.979 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0073672429999999999 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267310+0000", 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106405 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267393+0000", 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2995000000000001e-05 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.980 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292052+0000", 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024659062999999998 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292062+0000", 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.0535e-05 2024-06-11T16:00:53.981 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292101+0000", 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8625999999999999e-05 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.982 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292138+0000", 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6763e-05 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1616 4.3d 4:be78f56d:::100000004f7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.701675985, 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.038212589999999998, 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.983 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259932+0000", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259933+0000", 2024-06-11T16:00:53.984 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259935+0000", 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0320000000000002e-06 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259940+0000", 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7919999999999998e-06 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.985 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.259945+0000", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6650000000000002e-06 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292171+0000", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032226017000000003 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292271+0000", 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100084 2024-06-11T16:00:53.986 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292351+0000", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0216999999999994e-05 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294873+0000", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002521134 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298072+0000", 2024-06-11T16:00:53.987 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003199356 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298118+0000", 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6385999999999999e-05 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298145+0000", 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6491000000000001e-05 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.988 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1619 4.d 4:b1f4eda8:::100000004fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.701156783, 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037783840999999999, 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.989 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260451+0000", 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260452+0000", 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7599999999999997e-07 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.990 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260456+0000", 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4520000000000002e-06 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260463+0000", 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8460000000000008e-06 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260470+0000", 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6599999999999998e-06 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.991 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292186+0000", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031715879000000002 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292295+0000", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108865 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292387+0000", 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2493999999999999e-05 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.992 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0025994170000000001 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298151+0000", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.003164708 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298196+0000", 2024-06-11T16:00:53.993 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4399e-05 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298235+0000", 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9444999999999999e-05 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1623 4.1d 4:bb4f955a:::10000000503.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:53.994 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.700859254000001, 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.037564079, 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:53.995 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:53.996 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260749+0000", 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260752+0000", 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6029999999999999e-06 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.997 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260759+0000", 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.584e-06 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.260764+0000", 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5310000000000001e-06 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:53.998 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292596+0000", 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.031831766999999997 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292701+0000", 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105164 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292787+0000", 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6261000000000006e-05 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:53.999 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294987+0000", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021991979999999999 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298243+0000", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032563290000000001 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298280+0000", 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7425999999999997e-05 2024-06-11T16:00:54.000 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298313+0000", 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2700000000000002e-05 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1632 4.1d 4:ba94589b:::10000000512.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.699192311000001, 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035970082, 2024-06-11T16:00:54.001 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.002 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262416+0000", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3500000000000002e-07 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262418+0000", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1730000000000002e-06 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262426+0000", 2024-06-11T16:00:54.003 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.345e-06 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262431+0000", 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.135e-06 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293430+0000", 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030998593000000001 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.004 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293540+0000", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011092800000000001 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293630+0000", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9327999999999996e-05 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295708+0000", 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0020778989999999998 2024-06-11T16:00:54.005 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298319+0000", 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026112969999999998 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298355+0000", 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6154e-05 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.006 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298386+0000", 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0794999999999999e-05 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1637 4.5 4:a1286a69:::10000000518.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.698767325, 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.035627701999999997, 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.007 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262841+0000", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.008 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262842+0000", 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0400000000000005e-07 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262846+0000", 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.126e-06 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.009 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262855+0000", 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7790000000000001e-06 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.262861+0000", 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293337+0000", 2024-06-11T16:00:54.010 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030475965000000001 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293532+0000", 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00019501499999999999 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293621+0000", 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8584000000000004e-05 2024-06-11T16:00:54.011 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295729+0000", 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0021078329999999999 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298392+0000", 2024-06-11T16:00:54.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0026636429999999998 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298436+0000", 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3497e-05 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.298469+0000", 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2775999999999999e-05 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1639 4.25 4:a5515960:::1000000051b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.698574695, 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036591343999999998, 2024-06-11T16:00:54.014 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263033+0000", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263034+0000", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0500000000000002e-07 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263038+0000", 2024-06-11T16:00:54.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9249999999999997e-06 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263047+0000", 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7849999999999997e-06 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263054+0000", 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8229999999999997e-06 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293855+0000", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030801451000000001 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293969+0000", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113861 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294060+0000", 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0538999999999995e-05 2024-06-11T16:00:54.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296047+0000", 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019877850000000002 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299531+0000", 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034831419999999998 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.019 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299584+0000", 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3678999999999999e-05 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299625+0000", 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0549000000000001e-05 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1641 4.3d 4:bf543b63:::1000000051f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:54.020 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.698181875, 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036491295999999999, 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263426+0000", 2024-06-11T16:00:54.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263427+0000", 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4900000000000005e-07 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263431+0000", 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263441+0000", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3130000000000004e-06 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263448+0000", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3499999999999999e-06 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293910+0000", 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030461452999999999 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294018+0000", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108179 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294111+0000", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2801999999999997e-05 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296066+0000", 2024-06-11T16:00:54.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0019550819999999999 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299849+0000", 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0037838699999999999 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299878+0000", 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8435000000000001e-05 2024-06-11T16:00:54.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299918+0000", 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9675000000000002e-05 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1647 4.d 4:b0c88289:::10000000527.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.026 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.697668782000001, 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.036120318999999998, 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.027 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263939+0000", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263940+0000", 2024-06-11T16:00:54.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8999999999999996e-07 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263942+0000", 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0810000000000001e-06 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263948+0000", 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3779999999999998e-06 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.263954+0000", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9059999999999999e-06 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294534+0000", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.030579164999999998 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:54.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011285000000000001 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294737+0000", 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0289000000000002e-05 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296108+0000", 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001370853 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299980+0000", 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038721089999999999 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300020+0000", 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0212000000000001e-05 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300060+0000", 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9885999999999997e-05 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.032 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1660 4.1 4:82b713a8:::10000000633.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.695032995, 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025457119, 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.033 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266575+0000", 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266576+0000", 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.06e-07 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266578+0000", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.615e-06 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266585+0000", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0149999999999998e-06 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266592+0000", 2024-06-11T16:00:54.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6800000000000004e-06 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266630+0000", 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8024000000000001e-05 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266738+0000", 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010812800000000001 2024-06-11T16:00:54.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267301+0000", 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056244800000000001 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291912+0000", 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024611127 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291952+0000", 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0377000000000003e-05 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291997+0000", 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5142999999999998e-05 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292032+0000", 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5055999999999998e-05 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.038 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1661 4.21 4:842ba872:::10000000635.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.695006494999999, 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025531663, 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:54.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266602+0000", 2024-06-11T16:00:54.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2100000000000002e-07 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266604+0000", 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:54.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266611+0000", 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.28e-06 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.266615+0000", 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278178+0000", 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011562157999999999 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278265+0000", 2024-06-11T16:00:54.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.7328000000000001e-05 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278354+0000", 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8628000000000006e-05 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291923+0000", 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013569784999999999 2024-06-11T16:00:54.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292040+0000", 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000116766 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292093+0000", 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2388000000000001e-05 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.046 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292133+0000", 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0834999999999998e-05 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1664 4.1d 4:bb0cd6aa:::1000000063b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:54.047 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.694413331, 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032780803999999997, 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:54.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267195+0000", 2024-06-11T16:00:54.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267196+0000", 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3099999999999997e-07 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267199+0000", 2024-06-11T16:00:54.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1099999999999999e-06 2024-06-11T16:00:54.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267206+0000", 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8410000000000002e-06 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267211+0000", 2024-06-11T16:00:54.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7620000000000001e-06 2024-06-11T16:00:54.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.054 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.054 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294557+0000", 2024-06-11T16:00:54.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027345362000000002 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294646+0000", 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.9237e-05 2024-06-11T16:00:54.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.294707+0000", 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1062000000000006e-05 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296086+0000", 2024-06-11T16:00:54.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001379162 2024-06-11T16:00:54.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299923+0000", 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0038365439999999999 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299946+0000", 2024-06-11T16:00:54.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3458000000000001e-05 2024-06-11T16:00:54.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.299976+0000", 2024-06-11T16:00:54.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.9535000000000001e-05 2024-06-11T16:00:54.060 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.060 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.060 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1665 3.1d 3:bf8dcf43:::200.00000008:head [write 3917859~273603 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.694095962, 2024-06-11T16:00:54.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.033038038999999998, 2024-06-11T16:00:54.062 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.062 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.062 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.062 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267512+0000", 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267514+0000", 2024-06-11T16:00:54.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.697e-06 2024-06-11T16:00:54.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267923+0000", 2024-06-11T16:00:54.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00040869499999999999 2024-06-11T16:00:54.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267942+0000", 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8924999999999999e-05 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267948+0000", 2024-06-11T16:00:54.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0750000000000003e-06 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295014+0000", 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.02706648 2024-06-11T16:00:54.068 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295068+0000", 2024-06-11T16:00:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3535000000000002e-05 2024-06-11T16:00:54.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295127+0000", 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9083000000000003e-05 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.296941+0000", 2024-06-11T16:00:54.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0018142309999999999 2024-06-11T16:00:54.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300429+0000", 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0034882350000000001 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300468+0000", 2024-06-11T16:00:54.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8383999999999997e-05 2024-06-11T16:00:54.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300550+0000", 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.2699000000000002e-05 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.075 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1666 3.1d 3:bf8dcf43:::200.00000008:head [write 4191462~2769 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.075 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:54.075 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.693647922, 2024-06-11T16:00:54.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032663436999999997, 2024-06-11T16:00:54.076 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.076 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.076 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.076 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:54.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267960+0000", 2024-06-11T16:00:54.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267968+0000", 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.9910000000000002e-06 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267976+0000", 2024-06-11T16:00:54.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5490000000000001e-06 2024-06-11T16:00:54.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267983+0000", 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.6909999999999997e-06 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.081 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267988+0000", 2024-06-11T16:00:54.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:54.082 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.082 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295715+0000", 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027726397999999999 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295758+0000", 2024-06-11T16:00:54.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2799000000000001e-05 2024-06-11T16:00:54.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295831+0000", 2024-06-11T16:00:54.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3775000000000004e-05 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.297318+0000", 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001486535 2024-06-11T16:00:54.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300556+0000", 2024-06-11T16:00:54.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0032385080000000002 2024-06-11T16:00:54.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300592+0000", 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5957999999999997e-05 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.088 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.088 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300624+0000", 2024-06-11T16:00:54.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.1344999999999999e-05 2024-06-11T16:00:54.088 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.088 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1667 4.35 4:adc6aa94:::1000000063d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:54.089 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.693612494, 2024-06-11T16:00:54.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.032221202999999997, 2024-06-11T16:00:54.090 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.090 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.090 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.090 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:54.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267996+0000", 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267997+0000", 2024-06-11T16:00:54.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2190000000000001e-06 2024-06-11T16:00:54.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.267999+0000", 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9039999999999999e-06 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268005+0000", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6780000000000003e-06 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268010+0000", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5310000000000003e-06 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295746+0000", 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.027736427000000001 2024-06-11T16:00:54.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.295812+0000", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5340999999999997e-05 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300079+0000", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0042669320000000002 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300138+0000", 2024-06-11T16:00:54.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9787000000000002e-05 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.300217+0000", 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8384e-05 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1672 4.1e 4:79fcdc13:::10000000647.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.693520125999999, 2024-06-11T16:00:54.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025141502999999999, 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268088+0000", 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268089+0000", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.302e-06 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268092+0000", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.419e-06 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268096+0000", 2024-06-11T16:00:54.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5419999999999999e-06 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268101+0000", 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.527e-06 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268500+0000", 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00039913200000000001 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268592+0000", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.179e-05 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268660+0000", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8365e-05 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291921+0000", 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.023260461 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292389+0000", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046889099999999998 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292457+0000", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7848000000000005e-05 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293230+0000", 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00077222599999999999 2024-06-11T16:00:54.102 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1673 4.f 4:f13e857c:::10000000649.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.693501947, 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024847386999999999, 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268106+0000", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268107+0000", 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1850000000000001e-06 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268109+0000", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9750000000000001e-06 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268114+0000", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7520000000000004e-06 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268119+0000", 2024-06-11T16:00:54.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4719999999999997e-06 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279064+0000", 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010945013 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279513+0000", 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044898200000000001 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.279693+0000", 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00018039299999999999 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292755+0000", 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062127 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292873+0000", 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000117768 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292921+0000", 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8099999999999997e-05 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.292954+0000", 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2620000000000003e-05 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:1675 4.1e 4:7841a0e9:::1000000064d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.108 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 12.693455348000001, 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.025281485999999999, 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:54.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268153+0000", 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268154+0000", 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268156+0000", 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.024e-06 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268161+0000", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.011e-06 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.268166+0000", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.634e-06 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278284+0000", 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010118126 2024-06-11T16:00:54.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278385+0000", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100377 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "waiting for subops from 1", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.278471+0000", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6697e-05 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "sub_op_commit_rec", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.291959+0000", 2024-06-11T16:00:54.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013487791000000001 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "op_commit", 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293236+0000", 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012774520000000001 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "commit_sent", 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293289+0000", 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2210999999999999e-05 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:54.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:41.293434+0000", 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00014563400000000001 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:54.114 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:54.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-06-11T16:00:54.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:54.117+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:54.116 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:54.155 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] holes 2024-06-11T16:00:54.172 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] lstat64 2024-06-11T16:00:54.216 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:54.217+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:3706 3.6 e63/43 3:654134d2:::mds0_openfiles.0:head v 63'33, mlcod=63'31)", 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:54.222010+0000", 2024-06-11T16:00:54.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00092213099999999997, 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00093678299999999995, 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222010+0000", 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222010+0000", 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222011+0000", 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7850000000000001e-06 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222037+0000", 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5329000000000001e-05 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222049+0000", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1960000000000001e-05 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222074+0000", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5108000000000001e-05 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222140+0000", 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5914000000000006e-05 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222166+0000", 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6013999999999999e-05 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:54.222914+0000", 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00074824400000000001 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-06-11T16:00:54.225 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 1 2024-06-11T16:00:54.226 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:54.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:54.281 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] nametest 2024-06-11T16:00:54.316 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:54.317+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:54.324 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] permname 2024-06-11T16:00:54.335 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:54.335 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:54.335 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:54.335 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:54.335 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:54.344 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:54.418 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:54.419+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:54.437 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] randholes 2024-06-11T16:00:54.440 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] runas 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:54.451 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.261843627000001, 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:54.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.254885863999998, 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:54.456 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:54.460 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184330327, 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:54.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:54.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.465 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184284143999999, 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:54.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:54.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:54.470 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184265919, 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184233002999999, 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:54.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:54.479 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184210967, 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:54.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:54.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.484 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184101478000001, 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:54.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:54.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.184053301000001, 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:54.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:54.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183855872000001, 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.494 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:54.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:54.498 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183824516, 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.499 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:54.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183797603, 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:54.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183664325000001, 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:54.508 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:54.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:54.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.512 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183635342000001, 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:54.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183597918, 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.517 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:54.521 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.183136208000001, 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:54.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.182394997999999, 2024-06-11T16:00:54.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:54.527 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.527 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.527 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:54.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.533 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.18235009, 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:54.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:54.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:54.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:54.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.181949395, 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:54.539 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:54.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:54.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.181822438999999, 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:54.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:54.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:54.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:54.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:54.549 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:54.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:54.552+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:54.551 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:54.623 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] truncfile 2024-06-11T16:00:54.631 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] usemem 2024-06-11T16:00:54.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:54.653+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:54.659 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:54.659 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:54.659 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:54.659 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:54.668 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:54.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:54.706 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] mmapcat 2024-06-11T16:00:54.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:54.754+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:54.773 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:54.773 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:54.773 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:54.773 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:54.773 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:54.782 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:54.804 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] append_reader 2024-06-11T16:00:54.853 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:54.854+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:54.858 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:54.858 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:54.861 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] append_writer 2024-06-11T16:00:54.877 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is set 2024-06-11T16:00:54.884 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:54.885 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:54.890 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:54.890 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:54.893 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:54.897 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:54.897 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:54.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:54.914 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] dirperf 2024-06-11T16:00:54.954 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] metaperf 2024-06-11T16:00:54.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:54.955+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.005 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.005 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.014 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:55.044 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] devzero 2024-06-11T16:00:55.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.057+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.091 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] feature 2024-06-11T16:00:55.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.156+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.159 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.159 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:55.229 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] alloc 2024-06-11T16:00:55.256 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:55.257+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:55.311 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fault 2024-06-11T16:00:55.313 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.313 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.322 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:55.352 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] fstest 2024-06-11T16:00:55.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.358+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.381 INFO:tasks.workunit.client.0.smithi089.stdout: [CC] t_access_root 2024-06-11T16:00:55.418 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c: In function 'main': 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: 154 | bozo! 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~ 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: 154 | bozo! 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: | ^ 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: | ; 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: 184 | rflag = 1; 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~ 2024-06-11T16:00:55.419 INFO:tasks.workunit.client.0.smithi089.stderr: | nflag 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr: 320 | bozo! 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr: | ^ 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr: | ; 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr: 128 | struct flock64 f; 2024-06-11T16:00:55.420 INFO:tasks.workunit.client.0.smithi089.stderr: | ^ 2024-06-11T16:00:55.423 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-06-11T16:00:55.423 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-11T16:00:55.428 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.428 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.437 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:55.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.458+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.540 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.540 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.549 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:55.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.560+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.566 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c: In function 'run_child': 2024-06-11T16:00:55.566 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~ 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~ 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~ 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.567 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~ 2024-06-11T16:00:55.568 INFO:tasks.workunit.client.0.smithi089.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-06-11T16:00:55.568 INFO:tasks.workunit.client.0.smithi089.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-06-11T16:00:55.568 INFO:tasks.workunit.client.0.smithi089.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-11T16:00:55.646 INFO:tasks.workunit.client.0.smithi089.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-06-11T16:00:55.647 INFO:tasks.workunit.client.0.smithi089.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-06-11T16:00:55.647 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-06-11T16:00:55.648 INFO:tasks.workunit.client.0.smithi089.stderr:make: *** [Makefile:51: default] Error 2 2024-06-11T16:00:55.648 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-06-11T16:00:55.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-11T16:00:55.654 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.655 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.659 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:55.660+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:55.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:55.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:55.764+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:55.769 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.770 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.778 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:55.864 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:55.865+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:55.923 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:55.923 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:55.931 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:55.967 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:55.968+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:55.970 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi089 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f51ea3944d39ca13aa40153c9a4ee298306679d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-11T16:00:56.200 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f010bac23e314c18baf1790a113aa7da Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_3f51ea3944d39ca13aa40153c9a4ee298306679d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi089 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f51ea3944d39ca13aa40153c9a4ee298306679d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-11T16:00:56.202 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-11T16:00:56.212 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-11T16:00:56.212 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T16:00:56.212 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-11T16:00:56.218 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.218 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:56.218+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:56.219 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:56.233 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T16:00:56.233 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-11T16:00:56.289 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-11T16:00:56.318 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:56.319+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:56.324 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.325 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.333 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:56.418 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:56.419+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:56.478 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.478 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.487 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:56.528 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:56.529+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:56.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:56.622+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:56.624 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2024-06-11T16:00:56.630 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.630 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.637 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-06-11T16:00:56.637 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-11T16:00:56.639 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:56.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-11T16:00:56.721 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:56.723+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:56.744 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.745 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.753 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:56.822 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:56.824+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:56.858 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.858 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.867 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:56.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:00:56.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-06-11T16:00:56.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:56.924+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:56.973 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:56.973 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:56.981 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:56.998 INFO:teuthology.orchestra.run.smithi089.stderr:listed 0 entries 2024-06-11T16:00:57.016 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2024-06-11T16:00:57.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T16:00:57.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-11T16:00:57.025 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:57.026+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:57.027 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:57.027 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:57.041 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi089.stderr:ceph-fuse[34189]: fuse finished with error 0 and tester_r 0 2024-06-11T16:00:57.047 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:57.048 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:57.051 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:00:57.052 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:57.053 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:57.113 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3942 4.12 4:4a996524:::100000000e2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.091578+0000", 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.014666927999999999, 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014689077, 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.114 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091578+0000", 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091578+0000", 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091579+0000", 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.2000000000000001e-07 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091581+0000", 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.951e-06 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091586+0000", 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4790000000000004e-06 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091591+0000", 2024-06-11T16:00:57.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9509999999999997e-06 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092035+0000", 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044408099999999998 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092144+0000", 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109088 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3987 4.30 4:0c13cd34:::1000000010f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.120 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.096977+0000", 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0092678489999999999, 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0093437520000000003, 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096977+0000", 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096977+0000", 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096978+0000", 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6800000000000001e-07 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096979+0000", 2024-06-11T16:00:57.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7829999999999999e-06 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096986+0000", 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6359999999999997e-06 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096992+0000", 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4410000000000001e-06 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097205+0000", 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021329300000000001 2024-06-11T16:00:57.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097306+0000", 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010095899999999999 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.126 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4014 4.38 4:1c1bce02:::1000000012a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098951+0000", 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0072943180000000002, 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074186429999999999, 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.127 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098951+0000", 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098951+0000", 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098951+0000", 2024-06-11T16:00:57.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1099999999999996e-07 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098953+0000", 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7749999999999999e-06 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098959+0000", 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8549999999999998e-06 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098964+0000", 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1279999999999999e-06 2024-06-11T16:00:57.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099763+0000", 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00079912400000000001 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099859+0000", 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5286999999999998e-05 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3988 4.26 4:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.133 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097001+0000", 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0092444410000000008, 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0094157779999999996, 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097001+0000", 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097001+0000", 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097001+0000", 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9799999999999999e-07 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097003+0000", 2024-06-11T16:00:57.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1560000000000002e-06 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097010+0000", 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4590000000000003e-06 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097015+0000", 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2089999999999996e-06 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098475+0000", 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014599529999999999 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098568+0000", 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3202000000000007e-05 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4015 4.9 4.ddc5d0c9 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098970+0000", 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007275058, 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074926239999999998, 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.140 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098970+0000", 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098970+0000", 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098971+0000", 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8200000000000001e-07 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.142 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098972+0000", 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7179999999999999e-06 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098979+0000", 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3799999999999999e-06 2024-06-11T16:00:57.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098983+0000", 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.245e-06 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.144 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3956 4.37 4:ef416527:::100000000f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094309+0000", 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011936328, 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012191731000000001, 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.145 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094309+0000", 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094309+0000", 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094310+0000", 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1999999999999999e-07 2024-06-11T16:00:57.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094313+0000", 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.861e-06 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094325+0000", 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1088e-05 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094332+0000", 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0110000000000003e-06 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094380+0000", 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8089e-05 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094490+0000", 2024-06-11T16:00:57.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011007500000000001 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3989 4.22 4:46c9ad04:::10000000111.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097023+0000", 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0092226430000000009, 2024-06-11T16:00:57.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0095250720000000007, 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097023+0000", 2024-06-11T16:00:57.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097023+0000", 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097023+0000", 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1199999999999998e-07 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097025+0000", 2024-06-11T16:00:57.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.08e-06 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097031+0000", 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.246e-06 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097036+0000", 2024-06-11T16:00:57.155 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0370000000000002e-06 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097538+0000", 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00050146499999999998 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.156 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097639+0000", 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101313 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.157 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4016 4.2d 4:b4fb9bd9:::1000000012c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098988+0000", 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0072567059999999999, 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.007603327, 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.158 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098988+0000", 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098988+0000", 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098989+0000", 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.58e-07 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098996+0000", 2024-06-11T16:00:57.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2960000000000001e-06 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099002+0000", 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6019999999999999e-06 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.161 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099006+0000", 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6319999999999999e-06 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099084+0000", 2024-06-11T16:00:57.162 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8113000000000002e-05 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099542+0000", 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00045786399999999999 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.163 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3957 4.3f 4:fea3f43b:::100000000f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094354+0000", 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011891552999999999, 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012286946999999999, 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.164 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094354+0000", 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094354+0000", 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094354+0000", 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9500000000000003e-07 2024-06-11T16:00:57.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094357+0000", 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5679999999999998e-06 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094368+0000", 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.1311000000000001e-05 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094380+0000", 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2159e-05 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.168 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094427+0000", 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6390999999999997e-05 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.169 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094528+0000", 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101123 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.170 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3990 4.0 4:006fa129:::10000000112.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097042+0000", 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0092030329999999994, 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096438860000000008, 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.171 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097042+0000", 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097042+0000", 2024-06-11T16:00:57.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097042+0000", 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5400000000000002e-07 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097050+0000", 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.238e-06 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097057+0000", 2024-06-11T16:00:57.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9059999999999996e-06 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097062+0000", 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6999999999999996e-06 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.175 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097555+0000", 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00049240600000000003 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097663+0000", 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108187 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.176 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4017 4.37 4:ee6a6ac0:::1000000012d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099016+0000", 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0072289930000000004, 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0077149849999999997, 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.177 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099016+0000", 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.178 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099016+0000", 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099017+0000", 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0900000000000002e-07 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099018+0000", 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.793e-06 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099026+0000", 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2810000000000003e-06 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099031+0000", 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2469999999999999e-06 2024-06-11T16:00:57.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099507+0000", 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00047604599999999999 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.182 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099604+0000", 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7242000000000002e-05 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.183 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.36 epoch 64/33 rep_tid 9850 lcod 64'152)", 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099332+0000", 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0069132580000000003, 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0074427679999999998, 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.184 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099332+0000", 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099332+0000", 2024-06-11T16:00:57.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099332+0000", 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7100000000000001e-07 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099334+0000", 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6640000000000001e-06 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099340+0000", 2024-06-11T16:00:57.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1879999999999999e-06 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099344+0000", 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9269999999999998e-06 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.188 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3872 4.36 4:6c8b6cb2:::1000000009c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.082701+0000", 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.023543891000000001, 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.024111996, 2024-06-11T16:00:57.189 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.082701+0000", 2024-06-11T16:00:57.190 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.082701+0000", 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.082702+0000", 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4900000000000001e-07 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.082704+0000", 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1100000000000001e-06 2024-06-11T16:00:57.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.082710+0000", 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1530000000000002e-06 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.084009+0000", 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001298661 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086957+0000", 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.002948507 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.087168+0000", 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021042899999999999 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.195 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3958 4.33 4:cff7f4bd:::100000000f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094395+0000", 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011850382, 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012465155, 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.196 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094395+0000", 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094395+0000", 2024-06-11T16:00:57.197 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094395+0000", 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5300000000000004e-07 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094398+0000", 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5019999999999999e-06 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094405+0000", 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.447e-06 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.199 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094411+0000", 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4070000000000001e-06 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094491+0000", 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0320000000000003e-05 2024-06-11T16:00:57.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094657+0000", 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016625 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3992 4.0 4:005b64bc:::10000000114.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097070+0000", 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0091752829999999994, 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0098414880000000007, 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.202 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097070+0000", 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.203 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097070+0000", 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097070+0000", 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7100000000000002e-07 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.204 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097073+0000", 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2500000000000001e-06 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097079+0000", 2024-06-11T16:00:57.205 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4590000000000003e-06 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097084+0000", 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0180000000000001e-06 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.206 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098457+0000", 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0013729149999999999 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098557+0000", 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100022 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.207 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.13 epoch 64/43 rep_tid 9832 lcod 64'151)", 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099024+0000", 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0072213800000000003, 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0079309540000000005, 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.208 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099024+0000", 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099024+0000", 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099024+0000", 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0299999999999999e-07 2024-06-11T16:00:57.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099027+0000", 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.146e-06 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099035+0000", 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7819999999999994e-06 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099041+0000", 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8869999999999997e-06 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.212 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.3e epoch 64/33 rep_tid 9853 lcod 64'155)", 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099350+0000", 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0068952060000000001, 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0076433589999999997, 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.213 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099350+0000", 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099350+0000", 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099350+0000", 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2100000000000001e-07 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099352+0000", 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.587e-06 2024-06-11T16:00:57.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099358+0000", 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1530000000000002e-06 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099363+0000", 2024-06-11T16:00:57.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5700000000000003e-06 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3919 4.3a 4:5e2665ab:::100000000cb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.089834+0000", 2024-06-11T16:00:57.218 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.016411542000000001, 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017197027, 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089834+0000", 2024-06-11T16:00:57.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089834+0000", 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089834+0000", 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5300000000000004e-07 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089837+0000", 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.106e-06 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089845+0000", 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.1009999999999992e-06 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089853+0000", 2024-06-11T16:00:57.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.1690000000000003e-06 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090278+0000", 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000425353 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090381+0000", 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000103049 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.224 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3959 4.d 4:b0cc5b52:::100000000f3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094431+0000", 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011814013, 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012646292, 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094431+0000", 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094431+0000", 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094432+0000", 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1600000000000002e-07 2024-06-11T16:00:57.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094434+0000", 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5299999999999999e-06 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094441+0000", 2024-06-11T16:00:57.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8499999999999996e-06 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094446+0000", 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2070000000000003e-06 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094505+0000", 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8384999999999998e-05 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094620+0000", 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000115517 2024-06-11T16:00:57.230 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3993 4.2a 4:575ae04b:::10000000115.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097090+0000", 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0091551259999999995, 2024-06-11T16:00:57.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010032106000000001, 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097090+0000", 2024-06-11T16:00:57.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097090+0000", 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097090+0000", 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8599999999999999e-07 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097092+0000", 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.748e-06 2024-06-11T16:00:57.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097098+0000", 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1079999999999998e-06 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097103+0000", 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0089999999999998e-06 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097673+0000", 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00056952200000000004 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097772+0000", 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9396999999999997e-05 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.237 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4018 4.2 4:439e92fb:::1000000012e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099040+0000", 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0072046970000000004, 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0081262780000000007, 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.238 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099040+0000", 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.239 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099040+0000", 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099041+0000", 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9700000000000002e-07 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.240 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099043+0000", 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8759999999999999e-06 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.241 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099049+0000", 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0900000000000001e-06 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099053+0000", 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4619999999999998e-06 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.242 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099634+0000", 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00058092199999999999 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.243 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100006+0000", 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00037208400000000001 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3920 4.3e 4:7db06380:::100000000cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.089866+0000", 2024-06-11T16:00:57.244 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.016378843000000001, 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017346252, 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.245 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089866+0000", 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089866+0000", 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.246 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089867+0000", 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0499999999999999e-07 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089869+0000", 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1579999999999999e-06 2024-06-11T16:00:57.247 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089875+0000", 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2960000000000004e-06 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.248 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089880+0000", 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1449999999999999e-06 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090329+0000", 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00044829000000000001 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.249 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090435+0000", 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010632 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.250 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3944 4.39 4:9c66f7cb:::100000000e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092398+0000", 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013847593, 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014860585000000001, 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.251 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092398+0000", 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092398+0000", 2024-06-11T16:00:57.252 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092398+0000", 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9999999999999997e-07 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.253 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092402+0000", 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.765e-06 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092533+0000", 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013135299999999999 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.254 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092543+0000", 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4490000000000005e-06 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092583+0000", 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0342000000000001e-05 2024-06-11T16:00:57.255 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092683+0000", 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9491e-05 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.256 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3960 4.13 4:c97f6a48:::100000000f4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094456+0000", 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011789333000000001, 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012847791000000001, 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.257 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094456+0000", 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094456+0000", 2024-06-11T16:00:57.258 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094456+0000", 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.75e-07 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.259 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094458+0000", 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8500000000000001e-06 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094464+0000", 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.207e-06 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.260 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094470+0000", 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3199999999999999e-06 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095119+0000", 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00064911899999999998 2024-06-11T16:00:57.261 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095239+0000", 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000120585 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.262 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3994 4.17 4:ea138f4d:::10000000116.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097109+0000", 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0091360350000000007, 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010242469000000001, 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.263 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097109+0000", 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.264 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097109+0000", 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097110+0000", 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5900000000000003e-07 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.265 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097111+0000", 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.973e-06 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097117+0000", 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0120000000000002e-06 2024-06-11T16:00:57.266 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097122+0000", 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9849999999999997e-06 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.267 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097294+0000", 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000171559 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097394+0000", 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100091 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.268 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.23 epoch 64/17 rep_tid 9837 lcod 64'163)", 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099057+0000", 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071886290000000002, 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083374369999999996, 2024-06-11T16:00:57.269 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099057+0000", 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099057+0000", 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099057+0000", 2024-06-11T16:00:57.271 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.28e-07 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099059+0000", 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7719999999999999e-06 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.272 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099064+0000", 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4859999999999997e-06 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099068+0000", 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1520000000000002e-06 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.273 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.29 epoch 64/43 rep_tid 9857 lcod 64'159)", 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099384+0000", 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0068616479999999997, 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0080454540000000005, 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.274 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099384+0000", 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.275 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099384+0000", 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099384+0000", 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4399999999999999e-07 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.276 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099385+0000", 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.327e-06 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099390+0000", 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7419999999999997e-06 2024-06-11T16:00:57.277 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099394+0000", 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9740000000000004e-06 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.278 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3921 4.33 4:cc35cb30:::100000000cd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.089892+0000", 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.016352927999999999, 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017574709000000001, 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.279 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089892+0000", 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.280 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089892+0000", 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089893+0000", 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4799999999999999e-07 2024-06-11T16:00:57.281 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089895+0000", 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.39e-06 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.282 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089901+0000", 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0669999999999997e-06 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.089907+0000", 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3510000000000001e-06 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.283 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090018+0000", 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011156500000000001 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091052+0000", 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001034224 2024-06-11T16:00:57.284 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3961 4.2b 4:d6a65225:::100000000f5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.094846+0000", 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011399327000000001, 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01266635, 2024-06-11T16:00:57.285 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094846+0000", 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.286 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094846+0000", 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094846+0000", 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3600000000000003e-07 2024-06-11T16:00:57.287 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.094850+0000", 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5590000000000001e-06 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.288 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095061+0000", 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021105000000000001 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095069+0000", 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5680000000000002e-06 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.289 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095135+0000", 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6631999999999995e-05 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095244+0000", 2024-06-11T16:00:57.290 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108965 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3995 4.23 4:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097129+0000", 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0091162369999999993, 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010429512, 2024-06-11T16:00:57.291 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097129+0000", 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.292 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097129+0000", 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097129+0000", 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4200000000000001e-07 2024-06-11T16:00:57.293 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097131+0000", 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0490000000000002e-06 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097138+0000", 2024-06-11T16:00:57.294 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8759999999999999e-06 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097143+0000", 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8930000000000004e-06 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.295 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097868+0000", 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00072451899999999997 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097969+0000", 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101678 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.296 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4019 4.4 4:23f83e86:::1000000012f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099060+0000", 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071853689999999996, 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085444730000000003, 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.297 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099060+0000", 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.298 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099060+0000", 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099060+0000", 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9499999999999998e-07 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.299 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099062+0000", 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.875e-06 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099068+0000", 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2550000000000003e-06 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.300 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099073+0000", 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8640000000000004e-06 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099205+0000", 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013148700000000001 2024-06-11T16:00:57.301 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099301+0000", 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6705000000000003e-05 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.302 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3946 4.39 4:9de3e889:::100000000e6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092583+0000", 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013661863999999999, 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015068358, 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.303 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092583+0000", 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.304 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092583+0000", 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092584+0000", 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.82e-07 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.305 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092586+0000", 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2280000000000001e-06 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092594+0000", 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8709999999999997e-06 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.306 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092599+0000", 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1569999999999999e-06 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093009+0000", 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00041026600000000001 2024-06-11T16:00:57.307 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093110+0000", 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101146 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.308 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3962 4.b 4:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095081+0000", 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011164477000000001, 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012622758, 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.309 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095081+0000", 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095081+0000", 2024-06-11T16:00:57.310 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095081+0000", 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5400000000000001e-07 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.311 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095085+0000", 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.337e-06 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095094+0000", 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.0040000000000005e-06 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.312 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095100+0000", 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.55e-06 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095483+0000", 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038272099999999998 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.313 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095588+0000", 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000104947 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.314 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3996 4.25 4:a6db094f:::10000000118.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097156+0000", 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0090890369999999995, 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010594007000000001, 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.315 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097156+0000", 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097156+0000", 2024-06-11T16:00:57.316 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097157+0000", 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0200000000000003e-07 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.317 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097159+0000", 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.069e-06 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097167+0000", 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.6149999999999997e-06 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.318 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097173+0000", 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8799999999999996e-06 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097432+0000", 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00025849899999999998 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.319 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097544+0000", 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000112068 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.1b epoch 64/43 rep_tid 9856 lcod 64'157)", 2024-06-11T16:00:57.320 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099421+0000", 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0068246499999999998, 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0083764789999999992, 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.321 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099421+0000", 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099421+0000", 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.322 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099421+0000", 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.55e-07 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099422+0000", 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.336e-06 2024-06-11T16:00:57.323 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099427+0000", 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7840000000000003e-06 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.324 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099430+0000", 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.546e-06 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3899 4.13 4:c826941c:::100000000b7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.325 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.086059+0000", 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.020186463000000002, 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021775828000000001, 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.326 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086059+0000", 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086059+0000", 2024-06-11T16:00:57.327 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086059+0000", 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9900000000000001e-07 2024-06-11T16:00:57.328 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086066+0000", 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9800000000000001e-06 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.329 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086073+0000", 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7340000000000002e-06 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086078+0000", 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9559999999999996e-06 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.330 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.087713+0000", 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0016351849999999999 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.087822+0000", 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109039 2024-06-11T16:00:57.331 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3963 4.12 4:482fe7bc:::100000000f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095109+0000", 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011136392, 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012783131, 2024-06-11T16:00:57.332 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095109+0000", 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.333 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095109+0000", 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095109+0000", 2024-06-11T16:00:57.334 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1699999999999999e-07 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095122+0000", 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3047999999999999e-05 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.335 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095130+0000", 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095136+0000", 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7580000000000003e-06 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.336 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095172+0000", 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5657000000000001e-05 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095268+0000", 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5750999999999999e-05 2024-06-11T16:00:57.337 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3997 4.3 4:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097180+0000", 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.009065254, 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010758106, 2024-06-11T16:00:57.338 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097180+0000", 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.339 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097180+0000", 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097180+0000", 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7599999999999998e-07 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.340 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097182+0000", 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.956e-06 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097189+0000", 2024-06-11T16:00:57.341 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4810000000000003e-06 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097194+0000", 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0350000000000001e-06 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.342 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097948+0000", 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00075460800000000004 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098047+0000", 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8769000000000003e-05 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.343 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4020 4.15 4:abaacf15:::10000000130.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099079+0000", 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071661720000000002, 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0089075590000000007, 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.344 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099079+0000", 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.345 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099079+0000", 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099079+0000", 2024-06-11T16:00:57.346 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8099999999999998e-07 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099081+0000", 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.813e-06 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.347 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099087+0000", 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.694e-06 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099091+0000", 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4020000000000004e-06 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.348 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100012+0000", 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00092097499999999998 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100119+0000", 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106353 2024-06-11T16:00:57.349 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.33 epoch 64/24 rep_tid 9863 lcod 64'129)", 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099435+0000", 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0068102989999999997, 2024-06-11T16:00:57.350 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0085960610000000003, 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099435+0000", 2024-06-11T16:00:57.351 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099435+0000", 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.352 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099435+0000", 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2800000000000001e-07 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099437+0000", 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3259999999999998e-06 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.353 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099442+0000", 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7450000000000003e-06 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099446+0000", 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5379999999999998e-06 2024-06-11T16:00:57.354 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3900 4.23 4:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.086085+0000", 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.020160199, 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.021983717999999999, 2024-06-11T16:00:57.355 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086085+0000", 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.356 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086085+0000", 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086085+0000", 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7199999999999999e-07 2024-06-11T16:00:57.357 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086092+0000", 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3679999999999998e-06 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.358 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086098+0000", 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8610000000000003e-06 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.086102+0000", 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5519999999999998e-06 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.359 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.088059+0000", 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001956812 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.088167+0000", 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108348 2024-06-11T16:00:57.360 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3924 4.1b 4:d9cb565c:::100000000d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.090291+0000", 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.015953789999999999, 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017826112000000002, 2024-06-11T16:00:57.361 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090291+0000", 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.362 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090291+0000", 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090292+0000", 2024-06-11T16:00:57.363 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2300000000000001e-07 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090294+0000", 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.4650000000000001e-06 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.364 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090302+0000", 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.0150000000000003e-06 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090307+0000", 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8740000000000003e-06 2024-06-11T16:00:57.365 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090578+0000", 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00027086999999999999 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.366 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090680+0000", 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102357 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3947 4.36 4:6c62f82b:::100000000e7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092608+0000", 2024-06-11T16:00:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013637397000000001, 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015556006000000001, 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092608+0000", 2024-06-11T16:00:57.368 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092608+0000", 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092608+0000", 2024-06-11T16:00:57.369 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0299999999999999e-07 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092610+0000", 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.782e-06 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.370 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092616+0000", 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8640000000000001e-06 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092628+0000", 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2483999999999999e-05 2024-06-11T16:00:57.371 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093309+0000", 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00068010200000000003 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093407+0000", 2024-06-11T16:00:57.372 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8704999999999998e-05 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3965 4.f 4:f264201d:::100000000f9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095149+0000", 2024-06-11T16:00:57.373 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.011095906000000001, 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013062107, 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.374 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095149+0000", 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095149+0000", 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.375 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095150+0000", 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2200000000000004e-07 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095158+0000", 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.3510000000000002e-06 2024-06-11T16:00:57.376 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095166+0000", 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7849999999999992e-06 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095174+0000", 2024-06-11T16:00:57.377 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4749999999999996e-06 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095229+0000", 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5479999999999997e-05 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.378 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095339+0000", 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110337 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.379 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3998 4.2a 4:565108ac:::1000000011a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097202+0000", 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0090433360000000008, 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011054664000000001, 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.380 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097202+0000", 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097202+0000", 2024-06-11T16:00:57.381 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097202+0000", 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4200000000000001e-07 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.382 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097204+0000", 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9300000000000002e-06 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097210+0000", 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.088e-06 2024-06-11T16:00:57.383 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097216+0000", 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3489999999999999e-06 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.384 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098191+0000", 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00097563999999999995 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098294+0000", 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102892 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.385 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.36 epoch 64/33 rep_tid 9830 lcod 64'149)", 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099089+0000", 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071561319999999999, 2024-06-11T16:00:57.386 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0092127619999999993, 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099089+0000", 2024-06-11T16:00:57.387 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099089+0000", 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.388 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099089+0000", 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.54e-07 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099091+0000", 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.725e-06 2024-06-11T16:00:57.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099096+0000", 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5439999999999998e-06 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.390 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099100+0000", 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8079999999999998e-06 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100025+0000", 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00092474300000000001 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.391 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.b epoch 64/43 rep_tid 9862 lcod 64'161)", 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099457+0000", 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067879910000000002, 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0088835760000000007, 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.392 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099457+0000", 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.393 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099457+0000", 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.394 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099457+0000", 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5900000000000001e-07 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099459+0000", 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4130000000000001e-06 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.395 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099464+0000", 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4600000000000002e-06 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099468+0000", 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:57.396 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3948 4.1b 4:dba0574f:::100000000e8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092638+0000", 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013606863, 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.015741987999999998, 2024-06-11T16:00:57.397 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092638+0000", 2024-06-11T16:00:57.398 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092638+0000", 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.399 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092639+0000", 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7999999999999996e-07 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092641+0000", 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1600000000000001e-06 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.400 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092647+0000", 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.976e-06 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092652+0000", 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2780000000000001e-06 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.401 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092708+0000", 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5621000000000002e-05 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093284+0000", 2024-06-11T16:00:57.402 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00057657200000000002 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3966 4.2e 4:752cd5de:::100000000fa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.403 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095597+0000", 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010647884, 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012828556, 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.404 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095597+0000", 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095597+0000", 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.405 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095598+0000", 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3900000000000004e-07 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095602+0000", 2024-06-11T16:00:57.406 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.608e-06 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095610+0000", 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5709999999999998e-06 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095617+0000", 2024-06-11T16:00:57.407 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.725e-06 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095650+0000", 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3114000000000002e-05 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.408 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095751+0000", 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100689 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3999 4.36 4:6e600286:::1000000011b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097221+0000", 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0090240259999999992, 2024-06-11T16:00:57.409 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011250629999999999, 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.410 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097221+0000", 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097221+0000", 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.411 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097222+0000", 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5299999999999999e-07 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097223+0000", 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.728e-06 2024-06-11T16:00:57.412 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097229+0000", 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1530000000000002e-06 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.413 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097234+0000", 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6e-06 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098333+0000", 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001099034 2024-06-11T16:00:57.414 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098443+0000", 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109529 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.415 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4021 4.35 4:af7e9f79:::10000000131.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099097+0000", 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071481310000000003, 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0094200320000000001, 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.416 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099097+0000", 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099097+0000", 2024-06-11T16:00:57.417 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099097+0000", 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.51e-07 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.418 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099100+0000", 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0379999999999998e-06 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099106+0000", 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6969999999999996e-06 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.419 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099111+0000", 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6249999999999998e-06 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100270+0000", 2024-06-11T16:00:57.420 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0011594929999999999 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100487+0000", 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021676700000000001 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.421 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.13 epoch 64/43 rep_tid 9869 lcod 64'152)", 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099473+0000", 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067725980000000003, 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0090893239999999993, 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.422 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099473+0000", 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.423 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099473+0000", 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099473+0000", 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.68e-07 2024-06-11T16:00:57.424 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099474+0000", 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3039999999999999e-06 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.425 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099479+0000", 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8539999999999996e-06 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099482+0000", 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4189999999999998e-06 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.426 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3967 4.0 4:00b77ae3:::100000000fb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095631+0000", 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010614225, 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012969570999999999, 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.427 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095631+0000", 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.428 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095631+0000", 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095631+0000", 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6800000000000001e-07 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.429 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095639+0000", 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.8120000000000008e-06 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.430 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095647+0000", 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.7689999999999996e-06 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095653+0000", 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.733e-06 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.431 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095691+0000", 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7948000000000003e-05 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095782+0000", 2024-06-11T16:00:57.432 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1558999999999995e-05 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4000 4.b 4:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.433 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097239+0000", 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0090058770000000007, 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011408662, 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.434 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097239+0000", 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097239+0000", 2024-06-11T16:00:57.435 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097240+0000", 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.41e-07 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.436 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097246+0000", 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.618e-06 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.437 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097252+0000", 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0499999999999997e-06 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097257+0000", 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.916e-06 2024-06-11T16:00:57.438 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098489+0000", 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001232145 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.439 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098586+0000", 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6374999999999998e-05 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.e epoch 64/43 rep_tid 9833 lcod 64'135)", 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099105+0000", 2024-06-11T16:00:57.440 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071403739999999997, 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0095865369999999991, 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099105+0000", 2024-06-11T16:00:57.441 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099105+0000", 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.442 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099105+0000", 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.55e-07 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099106+0000", 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.389e-06 2024-06-11T16:00:57.443 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099111+0000", 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9409999999999998e-06 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.444 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099116+0000", 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2880000000000003e-06 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.1e epoch 64/43 rep_tid 9859 lcod 64'153)", 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099488+0000", 2024-06-11T16:00:57.445 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067572769999999999, 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0092409650000000003, 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.446 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099488+0000", 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099488+0000", 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.447 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099488+0000", 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5599999999999999e-07 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099489+0000", 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3549999999999999e-06 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099494+0000", 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7180000000000004e-06 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099498+0000", 2024-06-11T16:00:57.449 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4879999999999999e-06 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3968 4.36 4:6dd545dc:::100000000fc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095662+0000", 2024-06-11T16:00:57.450 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010583501, 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013104647000000001, 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.451 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095662+0000", 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095662+0000", 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.452 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095662+0000", 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0999999999999999e-07 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095664+0000", 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2060000000000001e-06 2024-06-11T16:00:57.453 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095671+0000", 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0389999999999999e-06 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.454 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095677+0000", 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3519999999999997e-06 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095762+0000", 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.5665000000000001e-05 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.455 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095881+0000", 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000118502 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4001 4.3a 4:5d261264:::1000000011d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097263+0000", 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0089826369999999999, 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011549494, 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097263+0000", 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097263+0000", 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097263+0000", 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.58e-07 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097265+0000", 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.716e-06 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097279+0000", 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4137e-05 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097284+0000", 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4500000000000003e-06 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098031+0000", 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00074692400000000005 2024-06-11T16:00:57.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098135+0000", 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000104299 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4022 4.28 4:14babc15:::10000000132.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099119+0000", 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071265210000000002, 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097409450000000009, 2024-06-11T16:00:57.463 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099119+0000", 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099119+0000", 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099119+0000", 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3999999999999997e-07 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099121+0000", 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.689e-06 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099126+0000", 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7200000000000003e-06 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099131+0000", 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8199999999999996e-06 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099826+0000", 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00069524599999999995 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099925+0000", 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8864999999999996e-05 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.469 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.26 epoch 64/43 rep_tid 9868 lcod 64'192)", 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099502+0000", 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067431419999999997, 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0094062620000000003, 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099502+0000", 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099502+0000", 2024-06-11T16:00:57.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099502+0000", 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9000000000000001e-07 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099504+0000", 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2839999999999999e-06 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099509+0000", 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3410000000000002e-06 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099513+0000", 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6969999999999999e-06 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.474 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3928 4.b 4:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.090398+0000", 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.015847228000000001, 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018557163000000002, 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090398+0000", 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090398+0000", 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090398+0000", 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7800000000000002e-07 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090400+0000", 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.007e-06 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090406+0000", 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1009999999999997e-06 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.478 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090412+0000", 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2630000000000003e-06 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090960+0000", 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00054797899999999998 2024-06-11T16:00:57.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.091056+0000", 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6304999999999994e-05 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.480 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3969 4.2d 4:b6610622:::100000000fd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095687+0000", 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010558247999999999, 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013330094000000001, 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.481 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095687+0000", 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095687+0000", 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095687+0000", 2024-06-11T16:00:57.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0400000000000002e-07 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095689+0000", 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0870000000000001e-06 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095695+0000", 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8610000000000003e-06 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095700+0000", 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9980000000000003e-06 2024-06-11T16:00:57.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095742+0000", 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.2049999999999999e-05 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.486 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095853+0000", 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110462 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4002 4.10 4:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097291+0000", 2024-06-11T16:00:57.487 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0089545979999999994, 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011787903000000001, 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097291+0000", 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097291+0000", 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097291+0000", 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5900000000000003e-07 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097293+0000", 2024-06-11T16:00:57.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0219999999999999e-06 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097299+0000", 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3690000000000003e-06 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097304+0000", 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9099999999999996e-06 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098286+0000", 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00098168499999999994 2024-06-11T16:00:57.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098379+0000", 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3296999999999998e-05 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.493 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.36 epoch 64/33 rep_tid 9835 lcod 64'150)", 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099120+0000", 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007125012, 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010082041999999999, 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.494 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099120+0000", 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099120+0000", 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099120+0000", 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.66e-07 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099122+0000", 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8220000000000001e-06 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099127+0000", 2024-06-11T16:00:57.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8300000000000003e-06 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099131+0000", 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1740000000000002e-06 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109101+0000", 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0099700399999999995 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.499 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.21 epoch 64/17 rep_tid 9865 lcod 64'188)", 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099518+0000", 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0067273869999999996, 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0097369150000000005, 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099518+0000", 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099518+0000", 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.501 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099518+0000", 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4999999999999999e-07 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099519+0000", 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3859999999999999e-06 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099524+0000", 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7609999999999998e-06 2024-06-11T16:00:57.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099528+0000", 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5260000000000002e-06 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109207+0000", 2024-06-11T16:00:57.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0096795079999999999 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3929 4.29 4:963c36ab:::100000000d5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.090418+0000", 2024-06-11T16:00:57.505 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.015827259999999999, 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.018899828, 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090418+0000", 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090418+0000", 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090418+0000", 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.1399999999999997e-07 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090420+0000", 2024-06-11T16:00:57.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7269999999999999e-06 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090427+0000", 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.939e-06 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090433+0000", 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.835e-06 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090571+0000", 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013852 2024-06-11T16:00:57.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090687+0000", 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011522400000000001 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3950 4.2a 4:54beb349:::100000000ea.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092725+0000", 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.01351978, 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01665227, 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.512 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092725+0000", 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092725+0000", 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092726+0000", 2024-06-11T16:00:57.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.13e-07 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092729+0000", 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.6970000000000002e-06 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.515 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092736+0000", 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.3810000000000001e-06 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092742+0000", 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8579999999999996e-06 2024-06-11T16:00:57.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092777+0000", 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4845000000000003e-05 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092873+0000", 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.6452000000000004e-05 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3970 4.3d 4:be8dfa60:::100000000fe.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.518 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095711+0000", 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010534549000000001, 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013730122000000001, 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095711+0000", 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095711+0000", 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095711+0000", 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095714+0000", 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.491e-06 2024-06-11T16:00:57.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095720+0000", 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4779999999999996e-06 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.522 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095726+0000", 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4569999999999996e-06 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095870+0000", 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000144129 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095995+0000", 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012537400000000001 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4003 4.2b 4:d6a4c2d3:::1000000011f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097311+0000", 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0089343400000000007, 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012189287, 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.525 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097311+0000", 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097311+0000", 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097311+0000", 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7999999999999996e-07 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097314+0000", 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.1859999999999999e-06 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097320+0000", 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1449999999999996e-06 2024-06-11T16:00:57.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097325+0000", 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9620000000000001e-06 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.529 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098613+0000", 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012884509999999999 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098725+0000", 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011178100000000001 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.530 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.26 epoch 64/43 rep_tid 9838 lcod 64'191)", 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099136+0000", 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071092500000000001, 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010345035000000001, 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.531 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "reached pg", 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099136+0000", 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099136+0000", 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099136+0000", 2024-06-11T16:00:57.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5599999999999999e-07 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099138+0000", 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5209999999999999e-06 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099143+0000", 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0640000000000001e-06 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099147+0000", 2024-06-11T16:00:57.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9740000000000004e-06 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109370+0000", 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010223381 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.536 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109481+0000", 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000110939 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.537 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3951 4.5 4:a3215264:::100000000eb.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092754+0000", 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013490957, 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.016867015999999999, 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.538 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092754+0000", 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092754+0000", 2024-06-11T16:00:57.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092755+0000", 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6800000000000001e-07 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092757+0000", 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2589999999999999e-06 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092764+0000", 2024-06-11T16:00:57.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.041e-06 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092770+0000", 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8869999999999997e-06 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092906+0000", 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000135938 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093391+0000", 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00048542099999999999 2024-06-11T16:00:57.543 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3971 4.13 4:ca01a157:::100000000ff.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095733+0000", 2024-06-11T16:00:57.544 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010512324999999999, 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013950822999999999, 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095733+0000", 2024-06-11T16:00:57.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095733+0000", 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095733+0000", 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.51e-07 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095735+0000", 2024-06-11T16:00:57.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.108e-06 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095742+0000", 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3570000000000003e-06 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095747+0000", 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0540000000000002e-06 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095861+0000", 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00011378399999999999 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095969+0000", 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108793 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.550 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4004 4.15 4:a96960f2:::10000000120.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097330+0000", 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0089152880000000004, 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012414158, 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.551 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097330+0000", 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097330+0000", 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097330+0000", 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.22e-07 2024-06-11T16:00:57.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097339+0000", 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2310000000000002e-06 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097346+0000", 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6479999999999997e-06 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097351+0000", 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:57.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097492+0000", 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000140858 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098003+0000", 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00051111099999999997 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4023 4.3d 4:beed21fb:::10000000133.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.557 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099137+0000", 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0071082319999999999, 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010669123000000001, 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099137+0000", 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099137+0000", 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099137+0000", 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5199999999999998e-07 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099139+0000", 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.807e-06 2024-06-11T16:00:57.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099146+0000", 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5440000000000004e-06 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099151+0000", 2024-06-11T16:00:57.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1089999999999997e-06 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100768+0000", 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001617425 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100872+0000", 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010338199999999999 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.563 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3972 4.16 4:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095753+0000", 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010492493, 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014116289000000001, 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095753+0000", 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095753+0000", 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095753+0000", 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6600000000000002e-07 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095755+0000", 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8899999999999999e-06 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095762+0000", 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8000000000000001e-06 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095767+0000", 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0780000000000003e-06 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096047+0000", 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00028038899999999997 2024-06-11T16:00:57.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096123+0000", 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.5566000000000001e-05 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4005 4.2d 4:b4f06a36:::10000000121.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097359+0000", 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0088861070000000007, 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012577942, 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.570 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097359+0000", 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097359+0000", 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097360+0000", 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4700000000000002e-07 2024-06-11T16:00:57.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097361+0000", 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9099999999999999e-06 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097367+0000", 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8200000000000002e-06 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097374+0000", 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.4139999999999999e-06 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097843+0000", 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00046956100000000001 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097951+0000", 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107292 2024-06-11T16:00:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.b epoch 64/43 rep_tid 9895 lcod 64'162)", 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109642+0000", 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9966035, 2024-06-11T16:00:57.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00035479700000000001, 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109642+0000", 2024-06-11T16:00:57.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109642+0000", 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109642+0000", 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3999999999999998e-07 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109644+0000", 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.621e-06 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109649+0000", 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2730000000000002e-06 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109653+0000", 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6399999999999996e-06 2024-06-11T16:00:57.580 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3932 4.1e 4:7b9ba906:::100000000d8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.090484+0000", 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.015761437, 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.019564657999999999, 2024-06-11T16:00:57.581 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090484+0000", 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090484+0000", 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090484+0000", 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5499999999999999e-07 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090486+0000", 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.739e-06 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090491+0000", 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2109999999999997e-06 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090496+0000", 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9509999999999997e-06 2024-06-11T16:00:57.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090714+0000", 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00021783300000000001 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.090817+0000", 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102672 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3953 4.1d 4:b9cee72b:::100000000ed.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.587 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.092809+0000", 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.013436060999999999, 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.017299365000000001, 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092809+0000", 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092809+0000", 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092810+0000", 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3300000000000003e-07 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092812+0000", 2024-06-11T16:00:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.973e-06 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092818+0000", 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0349999999999998e-06 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092823+0000", 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2340000000000002e-06 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.092993+0000", 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00016999100000000001 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.093085+0000", 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.2058999999999994e-05 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3973 4.3e 4:7d5083c7:::10000000101.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095773+0000", 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010471935999999999, 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014398664, 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.594 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095773+0000", 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095773+0000", 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095774+0000", 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.82e-07 2024-06-11T16:00:57.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095776+0000", 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8780000000000001e-06 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095782+0000", 2024-06-11T16:00:57.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1249999999999998e-06 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095787+0000", 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9150000000000004e-06 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096136+0000", 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00034976499999999998 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.599 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096235+0000", 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8125e-05 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4006 4.1e 4:7b093fa4:::10000000122.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097386+0000", 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0088594190000000003, 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012845670999999999, 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.601 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097386+0000", 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.602 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097386+0000", 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097386+0000", 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.9000000000000002e-07 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.603 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097388+0000", 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.063e-06 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097394+0000", 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2759999999999997e-06 2024-06-11T16:00:57.604 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097400+0000", 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.118e-06 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098698+0000", 2024-06-11T16:00:57.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001297996 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098804+0000", 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106767 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.606 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4024 4.2 4:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099156+0000", 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007088825, 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011136716, 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.607 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099156+0000", 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.608 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099156+0000", 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099157+0000", 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5900000000000003e-07 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.609 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099159+0000", 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.815e-06 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099164+0000", 2024-06-11T16:00:57.610 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4260000000000002e-06 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099168+0000", 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4139999999999996e-06 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.611 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100404+0000", 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001235173 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100499+0000", 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5280999999999998e-05 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.612 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.2e epoch 64/33 rep_tid 9896 lcod 64'144)", 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109660+0000", 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9965854, 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00069021200000000005, 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.613 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109660+0000", 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109660+0000", 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109660+0000", 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0699999999999999e-07 2024-06-11T16:00:57.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109661+0000", 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4750000000000001e-06 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109667+0000", 2024-06-11T16:00:57.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1950000000000002e-06 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109671+0000", 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0879999999999997e-06 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3974 4.13 4:ca2b2f16:::10000000102.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.095792+0000", 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.010452837, 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014612315000000001, 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.618 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095792+0000", 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.619 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095792+0000", 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095793+0000", 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.7099999999999997e-07 2024-06-11T16:00:57.620 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095795+0000", 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8360000000000001e-06 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.621 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095801+0000", 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0129999999999999e-06 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.095806+0000", 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9429999999999999e-06 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.622 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096192+0000", 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00038697100000000001 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096284+0000", 2024-06-11T16:00:57.623 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.1124000000000004e-05 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4007 4.36 4.9a0a9cf6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097405+0000", 2024-06-11T16:00:57.624 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0088400389999999992, 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013058494, 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097405+0000", 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097405+0000", 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.626 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097405+0000", 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4400000000000001e-07 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097407+0000", 2024-06-11T16:00:57.627 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.623e-06 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097413+0000", 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6620000000000002e-06 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.628 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097418+0000", 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0640000000000001e-06 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.36 epoch 64/33 rep_tid 9899 lcod 64'154)", 2024-06-11T16:00:57.629 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109675+0000", 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9965696, 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00083765300000000005, 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109675+0000", 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109675+0000", 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109676+0000", 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.85e-07 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109677+0000", 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.4190000000000001e-06 2024-06-11T16:00:57.632 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109682+0000", 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8899999999999998e-06 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.633 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109685+0000", 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5949999999999999e-06 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.634 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4008 4.27 4:e5c20fbc:::10000000124.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097423+0000", 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0088223969999999992, 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.01314038, 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.635 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097423+0000", 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097423+0000", 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097423+0000", 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.34e-07 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097425+0000", 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5939999999999999e-06 2024-06-11T16:00:57.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097430+0000", 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6760000000000004e-06 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.638 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097435+0000", 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6450000000000004e-06 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097541+0000", 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000106428 2024-06-11T16:00:57.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097639+0000", 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7274000000000004e-05 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4025 4.3f 4:fedcb8c2:::10000000135.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099174+0000", 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0070716429999999999, 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011451752000000001, 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.641 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099174+0000", 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.642 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099174+0000", 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099174+0000", 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.643 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099175+0000", 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5290000000000001e-06 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099180+0000", 2024-06-11T16:00:57.644 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7979999999999996e-06 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099190+0000", 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4040000000000001e-06 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.645 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099666+0000", 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00047662900000000001 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099764+0000", 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.7850000000000007e-05 2024-06-11T16:00:57.646 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3976 4.36 4:6f4aafed:::10000000104.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.096288+0000", 2024-06-11T16:00:57.647 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0099573600000000002, 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014397699, 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.648 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096288+0000", 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096288+0000", 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096288+0000", 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7400000000000003e-07 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.650 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096292+0000", 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5659999999999998e-06 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096311+0000", 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8771e-05 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096318+0000", 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.7340000000000002e-06 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096448+0000", 2024-06-11T16:00:57.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000130588 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096557+0000", 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000108847 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.653 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4009 4.14 4:2b82a036:::10000000125.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.097441+0000", 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0088045499999999995, 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.013307528000000001, 2024-06-11T16:00:57.654 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097441+0000", 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097441+0000", 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097441+0000", 2024-06-11T16:00:57.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4900000000000001e-07 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097443+0000", 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6929999999999999e-06 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.657 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097449+0000", 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3579999999999999e-06 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097454+0000", 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6500000000000004e-06 2024-06-11T16:00:57.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098829+0000", 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00137491 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098959+0000", 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013063300000000001 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.2d epoch 64/17 rep_tid 9898 lcod 64'143)", 2024-06-11T16:00:57.660 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109709+0000", 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9965367, 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001097998, 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109709+0000", 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109709+0000", 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109709+0000", 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.72e-07 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109710+0000", 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.358e-06 2024-06-11T16:00:57.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109715+0000", 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0340000000000004e-06 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109720+0000", 2024-06-11T16:00:57.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5369999999999999e-06 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4032 4.36 4.a6dbba36 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.100041+0000", 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0062040469999999999, 2024-06-11T16:00:57.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010817388000000001, 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100041+0000", 2024-06-11T16:00:57.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100041+0000", 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100042+0000", 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.9699999999999995e-07 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100045+0000", 2024-06-11T16:00:57.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.4199999999999999e-06 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100054+0000", 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.32e-06 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100061+0000", 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2910000000000002e-06 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4033 4.33 4:ce600bd1:::1000000013d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.100070+0000", 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.006175654, 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010842302999999999, 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100070+0000", 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100070+0000", 2024-06-11T16:00:57.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100070+0000", 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3599999999999999e-07 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100077+0000", 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0829999999999998e-06 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100083+0000", 2024-06-11T16:00:57.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3049999999999998e-06 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100088+0000", 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0490000000000003e-06 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.110691+0000", 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010602501 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.110792+0000", 2024-06-11T16:00:57.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000100772 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.3d epoch 64/43 rep_tid 9901 lcod 64'186)", 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109756+0000", 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.996489, 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0012154100000000001, 2024-06-11T16:00:57.677 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109756+0000", 2024-06-11T16:00:57.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109756+0000", 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109756+0000", 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7800000000000001e-07 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109758+0000", 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3960000000000001e-06 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109762+0000", 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6229999999999996e-06 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109767+0000", 2024-06-11T16:00:57.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.814e-06 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "pg_update_log_missing_reply(4.13 epoch 64/43 rep_tid 9904 lcod 64'156)", 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109772+0000", 2024-06-11T16:00:57.682 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9964728, 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001245185, 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109772+0000", 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109772+0000", 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109773+0000", 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.8199999999999999e-07 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109774+0000", 2024-06-11T16:00:57.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5230000000000001e-06 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109780+0000", 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6899999999999997e-06 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109783+0000", 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5039999999999998e-06 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4028 4.6 4.3d633946 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099229+0000", 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007016525, 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.011838230999999999, 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099229+0000", 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099229+0000", 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099229+0000", 2024-06-11T16:00:57.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3700000000000001e-07 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099231+0000", 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.717e-06 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099236+0000", 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1490000000000002e-06 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099241+0000", 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7650000000000001e-06 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.694 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4010 4.34 4:2f934c4e:::10000000126.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098842+0000", 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0074027269999999996, 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012272051000000001, 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.695 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098842+0000", 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098842+0000", 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098843+0000", 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.0900000000000001e-07 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098847+0000", 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8739999999999997e-06 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098854+0000", 2024-06-11T16:00:57.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.4460000000000004e-06 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098861+0000", 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0589999999999999e-06 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.699 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098945+0000", 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.4557999999999999e-05 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099044+0000", 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9042000000000005e-05 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.700 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:3984 4.d 4:b247ee27:::1000000010c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.096908+0000", 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0093374310000000002, 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.014270151999999999, 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.701 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096908+0000", 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096908+0000", 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096908+0000", 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.4499999999999997e-07 2024-06-11T16:00:57.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096910+0000", 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.153e-06 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096917+0000", 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.3820000000000001e-06 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.096922+0000", 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3009999999999997e-06 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097046+0000", 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00012387699999999999 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.097155+0000", 2024-06-11T16:00:57.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000109183 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4011 4.0 4:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098871+0000", 2024-06-11T16:00:57.707 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0073745959999999998, 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012367733000000001, 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098871+0000", 2024-06-11T16:00:57.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098871+0000", 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098871+0000", 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098873+0000", 2024-06-11T16:00:57.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9980000000000002e-06 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098879+0000", 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.0979999999999999e-06 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098884+0000", 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8409999999999999e-06 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099318+0000", 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00043369399999999998 2024-06-11T16:00:57.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099418+0000", 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9888000000000003e-05 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4030 4.1a 4:5997e84c:::1000000013a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099247+0000", 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0069984169999999998, 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012054838, 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.714 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099247+0000", 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099247+0000", 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099247+0000", 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.0899999999999997e-07 2024-06-11T16:00:57.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099254+0000", 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.6429999999999998e-06 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099259+0000", 2024-06-11T16:00:57.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2700000000000004e-06 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099263+0000", 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.437e-06 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100382+0000", 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0011182919999999999 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100476+0000", 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4778999999999995e-05 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.719 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4039 4.2e 4.3c2d9fee (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109898+0000", 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9963474, 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0014594569999999999, 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.720 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "queued for pg", 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109898+0000", 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109898+0000", 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109899+0000", 2024-06-11T16:00:57.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5799999999999999e-07 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109901+0000", 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3700000000000002e-06 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109907+0000", 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109912+0000", 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6210000000000001e-06 2024-06-11T16:00:57.724 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4012 4.2 4:4319aaa2:::10000000128.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098901+0000", 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.007344639, 2024-06-11T16:00:57.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012504664, 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.726 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098901+0000", 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098901+0000", 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.727 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098901+0000", 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.0400000000000002e-07 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098903+0000", 2024-06-11T16:00:57.728 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2970000000000002e-06 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098909+0000", 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8619999999999999e-06 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.729 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098915+0000", 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.9100000000000002e-06 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098951+0000", 2024-06-11T16:00:57.730 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099058+0000", 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107129 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.731 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4040 4.19 4:9ae704d2:::10000000144.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.109920+0000", 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4294967295.9963255, 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.001530963, 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.732 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109920+0000", 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.733 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109920+0000", 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109920+0000", 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.5100000000000001e-07 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.734 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109922+0000", 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.04e-06 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109928+0000", 2024-06-11T16:00:57.735 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.1160000000000004e-06 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109933+0000", 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9620000000000001e-06 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.736 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.110642+0000", 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00070837799999999996 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.110742+0000", 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00010028500000000001 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.737 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4013 4.1 4:802a5bbd:::10000000129.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.098926+0000", 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0073194669999999996, 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012558509000000001, 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.738 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098926+0000", 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.739 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098926+0000", 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098926+0000", 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.8100000000000003e-07 2024-06-11T16:00:57.740 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098928+0000", 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0899999999999999e-06 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098935+0000", 2024-06-11T16:00:57.741 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.737e-06 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.098940+0000", 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.0629999999999996e-06 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.742 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.109841+0000", 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.010900846 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.110020+0000", 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000179085 2024-06-11T16:00:57.743 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4031 4.1c 4:3800373d:::1000000013b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.099270+0000", 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.0069756050000000002, 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.012264929000000001, 2024-06-11T16:00:57.744 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099270+0000", 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.745 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099270+0000", 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099270+0000", 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.8599999999999999e-07 2024-06-11T16:00:57.746 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099272+0000", 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.872e-06 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099279+0000", 2024-06-11T16:00:57.747 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.8750000000000002e-06 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.099284+0000", 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8879999999999996e-06 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100070+0000", 2024-06-11T16:00:57.748 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00078687400000000002 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.100246+0000", 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000175558 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.749 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:57.750 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2024-06-11T16:00:57.750 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 105 2024-06-11T16:00:57.750 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:57.750 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:57.751 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:57.690+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:57.794 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:57.795+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:57.856 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:57.856 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:57.857 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:57.857 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:57.857 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:57.865 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:57.900 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is set 2024-06-11T16:00:57.906 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:57.907+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:57.990 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:57.991+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:58.010 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4142 4.13 4:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:58.011 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86184515799999994, 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085895401999999996, 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.012 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.013 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8000000000000004e-07 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149267+0000", 2024-06-11T16:00:58.014 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9599999999999999e-06 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149272+0000", 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7199999999999997e-06 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.015 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149277+0000", 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2719999999999997e-06 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229796+0000", 2024-06-11T16:00:58.016 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080518295000000004 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229915+0000", 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119202 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.017 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235160+0000", 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052450730000000003 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.018 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4145 4.13 4:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86179285900000002, 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085960287999999996, 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.019 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.020 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149318+0000", 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.212e-06 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.021 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149325+0000", 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2400000000000001e-06 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149330+0000", 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.022 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149335+0000", 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8690000000000003e-06 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230377+0000", 2024-06-11T16:00:58.023 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081042760000000005 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230479+0000", 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101326 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.024 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235277+0000", 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047983940000000001 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.025 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4149 4.1d 4:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86172643000000004, 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085887396000000005, 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.026 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:58.027 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149384+0000", 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2470000000000001e-06 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.028 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149386+0000", 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9819999999999998e-06 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149392+0000", 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1030000000000001e-06 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149396+0000", 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.515e-06 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229461+0000", 2024-06-11T16:00:58.030 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080064769999999993 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229560+0000", 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9191999999999995e-05 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.031 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235271+0000", 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057105869999999996 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4156 4.d 4:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.032 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86160489500000004, 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085877036000000004, 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.033 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.034 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149506+0000", 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2950000000000001e-06 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149508+0000", 2024-06-11T16:00:58.035 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.765e-06 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149512+0000", 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.036 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149517+0000", 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8550000000000001e-06 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229148+0000", 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.079630834999999997 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.037 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229251+0000", 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102599 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235382+0000", 2024-06-11T16:00:58.038 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061312830000000004 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4157 4.2d 4:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:58.039 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86158699299999997, 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086053058000000002, 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.040 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.041 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149524+0000", 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149525+0000", 2024-06-11T16:00:58.042 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6649999999999999e-06 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149530+0000", 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8369999999999996e-06 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.043 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149535+0000", 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230046+0000", 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080511451999999997 2024-06-11T16:00:58.044 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230145+0000", 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8655999999999999e-05 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.045 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235576+0000", 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054310280000000001 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.046 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4158 4.36 4:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86156986300000005, 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086091775999999995, 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.047 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:58.048 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149541+0000", 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5900000000000005e-07 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.049 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149543+0000", 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.934e-06 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149547+0000", 2024-06-11T16:00:58.050 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4750000000000004e-06 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149552+0000", 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5199999999999999e-06 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.051 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230647+0000", 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081095709000000002 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230759+0000", 2024-06-11T16:00:58.052 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111634 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235632+0000", 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048725449999999998 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.053 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4165 4.1 4:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.861425518, 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085906853000000005, 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.054 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.055 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149686+0000", 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.604e-06 2024-06-11T16:00:58.056 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149689+0000", 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8619999999999999e-06 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.057 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149693+0000", 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5879999999999999e-06 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149698+0000", 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1989999999999997e-06 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.058 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229941+0000", 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080242627999999996 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230081+0000", 2024-06-11T16:00:58.059 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013980899999999999 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235591+0000", 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055101630000000002 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.060 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4171 4.5 4:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86135936400000002, 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086065745999999999, 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.061 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.062 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149752+0000", 2024-06-11T16:00:58.063 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9860000000000001e-06 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149755+0000", 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7930000000000002e-06 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.064 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149759+0000", 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149764+0000", 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6940000000000003e-06 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.065 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230273+0000", 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080509163999999994 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230387+0000", 2024-06-11T16:00:58.066 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113478 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235816+0000", 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005429227 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.067 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4176 4.26 4:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86127883900000002, 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088072037000000006, 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.068 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.069 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149833+0000", 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.069e-06 2024-06-11T16:00:58.070 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149835+0000", 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.951e-06 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149840+0000", 2024-06-11T16:00:58.071 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9219999999999996e-06 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149845+0000", 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3680000000000001e-06 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.072 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231857+0000", 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082011375999999997 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231964+0000", 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107586 2024-06-11T16:00:58.073 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237903+0000", 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059387650000000004 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.074 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4179 4.e 4:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86120750700000004, 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088128012000000006, 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.075 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.076 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149904+0000", 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6249999999999999e-06 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.077 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149907+0000", 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.05e-06 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149912+0000", 2024-06-11T16:00:58.078 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7010000000000004e-06 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149917+0000", 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.682e-06 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.079 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232169+0000", 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082251357999999997 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232315+0000", 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000146236 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.080 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238030+0000", 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057153600000000001 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4180 4.1 4:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.081 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86118566699999999, 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085857708000000005, 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.082 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.083 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149926+0000", 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.674e-06 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149928+0000", 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3719999999999999e-06 2024-06-11T16:00:58.084 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149933+0000", 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6879999999999998e-06 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149937+0000", 2024-06-11T16:00:58.085 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6210000000000003e-06 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231335+0000", 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081397894999999998 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.086 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231401+0000", 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5963999999999994e-05 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235782+0000", 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043804940000000004 2024-06-11T16:00:58.087 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4183 4.3e 4:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86111876899999995, 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087979063999999996, 2024-06-11T16:00:58.088 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.089 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.090 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149993+0000", 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0480000000000001e-06 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149996+0000", 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.576e-06 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.091 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150001+0000", 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1139999999999997e-06 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150006+0000", 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2259999999999996e-06 2024-06-11T16:00:58.092 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232531+0000", 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082525077000000002 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232593+0000", 2024-06-11T16:00:58.093 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2198000000000003e-05 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237970+0000", 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005376825 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.094 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4189 4.6 4:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86099760700000005, 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087910825999999997, 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.095 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.096 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150114+0000", 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.564e-06 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.097 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150116+0000", 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2309999999999999e-06 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150120+0000", 2024-06-11T16:00:58.098 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4349999999999999e-06 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150125+0000", 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1000000000000003e-06 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.099 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232777+0000", 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082651599000000006 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232833+0000", 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5556999999999997e-05 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.100 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238023+0000", 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051903399999999999 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4194 4.2e 4:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.101 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86091088500000001, 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087945208999999996, 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:58.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150200+0000", 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.669e-06 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150203+0000", 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0600000000000002e-06 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150207+0000", 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.578e-06 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150213+0000", 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232942+0000", 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082729331000000003 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233048+0000", 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105846 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.107 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238144+0000", 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0050960739999999999 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4200 4.13 4:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.108 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86066584899999998, 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087359823000000003, 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150446+0000", 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7549999999999999e-06 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150448+0000", 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.136e-06 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150453+0000", 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9139999999999999e-06 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150458+0000", 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1120000000000004e-06 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231308+0000", 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080850147999999997 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231694+0000", 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000386334 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237804+0000", 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061094239999999996 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4212 4.13 4:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86043035499999998, 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087232062999999999, 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150681+0000", 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.903e-06 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150684+0000", 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5749999999999999e-06 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150689+0000", 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.843e-06 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150693+0000", 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3159999999999998e-06 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231916+0000", 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081222630000000004 2024-06-11T16:00:58.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232010+0000", 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4808000000000004e-05 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237911+0000", 2024-06-11T16:00:58.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059009880000000002 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4213 4.33 4:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86041129699999996, 2024-06-11T16:00:58.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087147416000000005, 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:58.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150700+0000", 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5379999999999999e-06 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150702+0000", 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.761e-06 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150706+0000", 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150711+0000", 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3789999999999997e-06 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231878+0000", 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081166901 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231978+0000", 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9943000000000002e-05 2024-06-11T16:00:58.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237846+0000", 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058674679999999998 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4214 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86039286699999995, 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087237145000000002, 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:58.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150718+0000", 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3939999999999999e-06 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150720+0000", 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.968e-06 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150725+0000", 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150729+0000", 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3619999999999999e-06 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232268+0000", 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081539434999999993 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232367+0000", 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8278999999999999e-05 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237954+0000", 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055872810000000004 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4219 4.36 4:6fe38dc2:::100000001f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86029642399999995, 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087259935999999996, 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:58.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150815+0000", 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.353e-06 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150816+0000", 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.843e-06 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150821+0000", 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3080000000000001e-06 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150826+0000", 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3550000000000004e-06 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233020+0000", 2024-06-11T16:00:58.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082193980999999999 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233076+0000", 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5577e-05 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.141 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238073+0000", 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049975189999999997 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4220 4.19 4:997b7129:::100000001f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:58.142 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 0.86027725600000005, 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087078016999999994, 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:58.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:58.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150833+0000", 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.034e-06 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:58.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150836+0000", 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2359999999999999e-06 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150840+0000", 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5759999999999999e-06 2024-06-11T16:00:58.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150845+0000", 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7679999999999999e-06 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231518+0000", 2024-06-11T16:00:58.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080672819000000007 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231691+0000", 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017314300000000001 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237910+0000", 2024-06-11T16:00:58.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006219441 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:58.149 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:58.151 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:58.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.151+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.252+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.260 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:58.260 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:58.260 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:00:58.260 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:58.268 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:58.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.353+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.413 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:58.413 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:00:58.413 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:00:58.413 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:00:58.413 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:58.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:58.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.463+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.554+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.567 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.378045434000001, 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:00:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:00:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.371087671000002, 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:00:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:00:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300532134000001, 2024-06-11T16:00:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:00:58.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300485950999999, 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:00:58.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:00:58.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300467726000001, 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:00:58.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:00:58.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300434809999999, 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.608 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:00:58.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:00:58.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:00:58.615 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300412774000002, 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:00:58.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:00:58.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:00:58.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300303284999998, 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:00:58.623 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:00:58.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300255108000002, 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.631 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:58.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:00:58.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:00:58.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:00:58.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:00:58.638 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300057678999998, 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:00:58.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:00:58.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.645 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.300026323000001, 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:00:58.646 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:58.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:00:58.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.653 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.299999410000002, 2024-06-11T16:00:58.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:58.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:00:58.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:00:58.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.299866131999998, 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.662 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:00:58.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:00:58.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.669 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.299837148999998, 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:58.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:00:58.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:00:58.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.299799725, 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.677 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:00:58.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:00:58.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.299338015, 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.684 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:00:58.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:00:58.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.298596804999999, 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.692 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:00:58.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:00:58.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:00:58.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.298551896999999, 2024-06-11T16:00:58.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:00:58.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:00:58.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:00:58.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.706 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.298151202, 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:00:58.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:00:58.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.298024246000001, 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:00:58.715 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:00:58.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:00:58.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.722 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:00:58.723 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:00:58.723 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:00:58.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.725+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.725 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:58.825 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:58.826+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:58.831 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:58.831 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:58.831 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:00:58.831 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:58.839 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:58.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:58.927+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:58.984 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:58.985 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:00:58.985 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:00:58.985 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:00:58.985 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:58.993 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:59.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:59.028+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:59.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:00:59.099 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:00:59.099 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:00:59.099 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:00:59.099 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:00:59.099 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4142 4.13 4:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.95010478, 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085895401999999996, 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.100 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:59.101 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8000000000000004e-07 2024-06-11T16:00:59.102 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149267+0000", 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9599999999999999e-06 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.103 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149272+0000", 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7199999999999997e-06 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149277+0000", 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2719999999999997e-06 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.104 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229796+0000", 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080518295000000004 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229915+0000", 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119202 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.105 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235160+0000", 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052450730000000003 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.106 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4145 4.13 4:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9500524809999999, 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085960287999999996, 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.107 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:00:59.108 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149318+0000", 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.212e-06 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.109 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149325+0000", 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2400000000000001e-06 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149330+0000", 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:00:59.110 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149335+0000", 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8690000000000003e-06 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.111 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230377+0000", 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081042760000000005 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230479+0000", 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101326 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.112 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235277+0000", 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047983940000000001 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.113 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4149 4.1d 4:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9499860519999999, 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085887396000000005, 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.114 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.115 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149384+0000", 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2470000000000001e-06 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149386+0000", 2024-06-11T16:00:59.116 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9819999999999998e-06 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149392+0000", 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1030000000000001e-06 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.117 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149396+0000", 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.515e-06 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229461+0000", 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080064769999999993 2024-06-11T16:00:59.118 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229560+0000", 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9191999999999995e-05 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235271+0000", 2024-06-11T16:00:59.119 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057105869999999996 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4156 4.d 4:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.949864517, 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085877036000000004, 2024-06-11T16:00:59.120 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.121 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.122 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149506+0000", 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2950000000000001e-06 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149508+0000", 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.765e-06 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.123 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149512+0000", 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149517+0000", 2024-06-11T16:00:59.124 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8550000000000001e-06 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229148+0000", 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.079630834999999997 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.125 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229251+0000", 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102599 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235382+0000", 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061312830000000004 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.126 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4157 4.2d 4:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.949846615, 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086053058000000002, 2024-06-11T16:00:59.127 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.128 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.129 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149524+0000", 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149525+0000", 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6649999999999999e-06 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.130 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149530+0000", 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8369999999999996e-06 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149535+0000", 2024-06-11T16:00:59.131 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230046+0000", 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080511451999999997 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.132 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230145+0000", 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8655999999999999e-05 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235576+0000", 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054310280000000001 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.133 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4158 4.36 4:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.949829485, 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086091775999999995, 2024-06-11T16:00:59.134 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.135 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.136 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149541+0000", 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5900000000000005e-07 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149543+0000", 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.934e-06 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.137 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149547+0000", 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4750000000000004e-06 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149552+0000", 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5199999999999999e-06 2024-06-11T16:00:59.138 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230647+0000", 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081095709000000002 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.139 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230759+0000", 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111634 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235632+0000", 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048725449999999998 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.140 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4165 4.1 4:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9496851400000001, 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085906853000000005, 2024-06-11T16:00:59.141 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.142 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149686+0000", 2024-06-11T16:00:59.143 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.604e-06 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149689+0000", 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8619999999999999e-06 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.144 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149693+0000", 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5879999999999999e-06 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149698+0000", 2024-06-11T16:00:59.145 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1989999999999997e-06 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229941+0000", 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080242627999999996 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.146 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230081+0000", 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013980899999999999 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235591+0000", 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055101630000000002 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.147 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4171 4.5 4:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9496189859999999, 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086065745999999999, 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.148 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.149 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149752+0000", 2024-06-11T16:00:59.150 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9860000000000001e-06 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149755+0000", 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7930000000000002e-06 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.151 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149759+0000", 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149764+0000", 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6940000000000003e-06 2024-06-11T16:00:59.152 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230273+0000", 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080509163999999994 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.153 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230387+0000", 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113478 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235816+0000", 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005429227 2024-06-11T16:00:59.154 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4176 4.26 4:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9495384609999999, 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088072037000000006, 2024-06-11T16:00:59.155 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.156 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149833+0000", 2024-06-11T16:00:59.157 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.069e-06 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149835+0000", 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.951e-06 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.158 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149840+0000", 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9219999999999996e-06 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149845+0000", 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3680000000000001e-06 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.159 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231857+0000", 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082011375999999997 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231964+0000", 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107586 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.160 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237903+0000", 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059387650000000004 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4179 4.e 4:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.161 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9494671289999999, 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088128012000000006, 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.162 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.163 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149904+0000", 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6249999999999999e-06 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149907+0000", 2024-06-11T16:00:59.164 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.05e-06 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149912+0000", 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7010000000000004e-06 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.165 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149917+0000", 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.682e-06 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232169+0000", 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082251357999999997 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.166 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232315+0000", 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000146236 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238030+0000", 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057153600000000001 2024-06-11T16:00:59.167 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4180 4.1 4:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.949445289, 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085857708000000005, 2024-06-11T16:00:59.168 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:59.169 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.170 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149926+0000", 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.674e-06 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149928+0000", 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3719999999999999e-06 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.171 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149933+0000", 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6879999999999998e-06 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149937+0000", 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6210000000000003e-06 2024-06-11T16:00:59.172 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231335+0000", 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081397894999999998 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.173 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231401+0000", 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5963999999999994e-05 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235782+0000", 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043804940000000004 2024-06-11T16:00:59.174 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4183 4.3e 4:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.949378391, 2024-06-11T16:00:59.175 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087979063999999996, 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.176 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.177 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149993+0000", 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0480000000000001e-06 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149996+0000", 2024-06-11T16:00:59.178 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.576e-06 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150001+0000", 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1139999999999997e-06 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.179 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150006+0000", 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2259999999999996e-06 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232531+0000", 2024-06-11T16:00:59.180 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082525077000000002 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232593+0000", 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2198000000000003e-05 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.181 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237970+0000", 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005376825 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.182 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4189 4.6 4:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9492572290000001, 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087910825999999997, 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.183 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.184 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150114+0000", 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.564e-06 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.185 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150116+0000", 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2309999999999999e-06 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150120+0000", 2024-06-11T16:00:59.186 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4349999999999999e-06 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150125+0000", 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1000000000000003e-06 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.187 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232777+0000", 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082651599000000006 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232833+0000", 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5556999999999997e-05 2024-06-11T16:00:59.188 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238023+0000", 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051903399999999999 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.189 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4194 4.2e 4:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9491705070000001, 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087945208999999996, 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.190 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.191 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150200+0000", 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.669e-06 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.192 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150203+0000", 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0600000000000002e-06 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150207+0000", 2024-06-11T16:00:59.193 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.578e-06 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150213+0000", 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.194 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232942+0000", 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082729331000000003 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233048+0000", 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105846 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.195 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238144+0000", 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0050960739999999999 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.196 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4200 4.13 4:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9489254709999999, 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087359823000000003, 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.197 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:00:59.198 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150446+0000", 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7549999999999999e-06 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.199 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150448+0000", 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.136e-06 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150453+0000", 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9139999999999999e-06 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.200 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150458+0000", 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1120000000000004e-06 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231308+0000", 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080850147999999997 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.201 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231694+0000", 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000386334 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237804+0000", 2024-06-11T16:00:59.202 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061094239999999996 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4212 4.13 4:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9486899769999999, 2024-06-11T16:00:59.203 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087232062999999999, 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.204 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.205 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150681+0000", 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.903e-06 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150684+0000", 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5749999999999999e-06 2024-06-11T16:00:59.206 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150689+0000", 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.843e-06 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.207 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150693+0000", 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3159999999999998e-06 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231916+0000", 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081222630000000004 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.208 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232010+0000", 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4808000000000004e-05 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237911+0000", 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059009880000000002 2024-06-11T16:00:59.209 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4213 4.33 4:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.948670919, 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087147416000000005, 2024-06-11T16:00:59.210 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.211 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150700+0000", 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5379999999999999e-06 2024-06-11T16:00:59.212 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150702+0000", 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.761e-06 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150706+0000", 2024-06-11T16:00:59.213 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150711+0000", 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3789999999999997e-06 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.214 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231878+0000", 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081166901 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231978+0000", 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9943000000000002e-05 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.215 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237846+0000", 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058674679999999998 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.216 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4214 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9486524890000001, 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087237145000000002, 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.217 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.218 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150718+0000", 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3939999999999999e-06 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.219 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150720+0000", 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.968e-06 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150725+0000", 2024-06-11T16:00:59.220 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150729+0000", 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3619999999999999e-06 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.221 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232268+0000", 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081539434999999993 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232367+0000", 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8278999999999999e-05 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.222 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237954+0000", 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055872810000000004 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.223 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4219 4.36 4:6fe38dc2:::100000001f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.948556046, 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087259935999999996, 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.224 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.225 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150815+0000", 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.353e-06 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.226 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150816+0000", 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.843e-06 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150821+0000", 2024-06-11T16:00:59.227 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3080000000000001e-06 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150826+0000", 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3550000000000004e-06 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.228 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233020+0000", 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082193980999999999 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233076+0000", 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5577e-05 2024-06-11T16:00:59.229 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238073+0000", 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049975189999999997 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.230 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4220 4.19 4:997b7129:::100000001f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 1.9485368780000001, 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087078016999999994, 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:00:59.231 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:00:59.232 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150833+0000", 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.034e-06 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.233 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150836+0000", 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2359999999999999e-06 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150840+0000", 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5759999999999999e-06 2024-06-11T16:00:59.234 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150845+0000", 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7679999999999999e-06 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231518+0000", 2024-06-11T16:00:59.235 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080672819000000007 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231691+0000", 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017314300000000001 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:00:59.236 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237910+0000", 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006219441 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:00:59.237 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:00:59.238 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:00:59.239 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:00:59.240 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:00:59.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:00:59.241 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:00:59.242 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:00:59.242 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:00:59.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:00:59.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:59.239+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:59.340 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:59.341+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:59.348 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:59.349 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:59.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:00:59.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:59.441+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:59.462 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:59.462 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:59.471 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:00:59.542 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:59.543+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:59.617 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:59.617 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:59.627 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:00:59.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:00:59.644+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:00:59.732 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:59.732 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:59.741 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:00:59.744 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:59.744+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:59.844 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:59.845+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:00:59.845 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:00:59.845 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:00:59.854 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:00:59.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:00:59.945 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:00:59.946+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.000 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.000 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.008 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:01:00.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-06-11T16:01:00.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:00.053+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:00.113 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.114 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.122 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:01:00.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:00.164+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:00.247 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.247+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.268 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.269 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:01:00.348 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.348+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.382 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.382 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.391 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:01:00.449 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.448+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.498 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.498 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.506 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:01:00.549 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.549+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.650 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.650 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:00.651+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:00.658 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:01:00.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:00.752+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:00.763 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.763 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.772 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:01:00.852 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.852+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.879 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.879 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:00.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:01:00.912 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:01:00.953 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:00.954+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:00.992 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:00.993 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:01.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:01:01.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.055+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.108 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:01.108 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:01.116 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:01:01.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.158+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.224 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:01.225 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:01.234 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:01:01.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-06-11T16:01:01.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.257+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.339 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:01.340 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:01.349 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:01:01.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.357+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.377 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:01:01.377 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:01:01.394 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:01:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:01:01.395 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:01:01.398 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:01:01.398 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:01:01.455 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:01:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:01:01.455 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4142 4.13 4:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3060239200000003, 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085895401999999996, 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.456 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.457 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8000000000000004e-07 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.458 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149267+0000", 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9599999999999999e-06 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.459 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149272+0000", 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7199999999999997e-06 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149277+0000", 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2719999999999997e-06 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.460 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229796+0000", 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080518295000000004 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229915+0000", 2024-06-11T16:01:01.461 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119202 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235160+0000", 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052450730000000003 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.462 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4145 4.13 4:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3059716210000003, 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085960287999999996, 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.463 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.464 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149318+0000", 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.212e-06 2024-06-11T16:01:01.465 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149325+0000", 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2400000000000001e-06 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.466 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149330+0000", 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149335+0000", 2024-06-11T16:01:01.467 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8690000000000003e-06 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230377+0000", 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081042760000000005 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.468 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230479+0000", 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101326 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235277+0000", 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047983940000000001 2024-06-11T16:01:01.469 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4149 4.1d 4:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.470 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.305905192, 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085887396000000005, 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.471 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.472 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149384+0000", 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2470000000000001e-06 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149386+0000", 2024-06-11T16:01:01.473 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9819999999999998e-06 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149392+0000", 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1030000000000001e-06 2024-06-11T16:01:01.474 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149396+0000", 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.515e-06 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.475 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229461+0000", 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080064769999999993 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229560+0000", 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9191999999999995e-05 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.476 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235271+0000", 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057105869999999996 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.477 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4156 4.d 4:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3057836570000001, 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085877036000000004, 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.478 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:01.479 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.480 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.480 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.480 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.480 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149506+0000", 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2950000000000001e-06 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149508+0000", 2024-06-11T16:01:01.481 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.765e-06 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149512+0000", 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.482 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149517+0000", 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8550000000000001e-06 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229148+0000", 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.079630834999999997 2024-06-11T16:01:01.483 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229251+0000", 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102599 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.484 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235382+0000", 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061312830000000004 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.485 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4157 4.2d 4:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3057657550000004, 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086053058000000002, 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.486 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:01.487 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149524+0000", 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.488 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149525+0000", 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6649999999999999e-06 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149530+0000", 2024-06-11T16:01:01.489 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8369999999999996e-06 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149535+0000", 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.490 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230046+0000", 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080511451999999997 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230145+0000", 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8655999999999999e-05 2024-06-11T16:01:01.491 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235576+0000", 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054310280000000001 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.492 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4158 4.36 4:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3057486249999997, 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086091775999999995, 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.493 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.494 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149541+0000", 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5900000000000005e-07 2024-06-11T16:01:01.495 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149543+0000", 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.934e-06 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.496 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149547+0000", 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4750000000000004e-06 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149552+0000", 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5199999999999999e-06 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.497 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230647+0000", 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081095709000000002 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.498 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230759+0000", 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111634 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235632+0000", 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048725449999999998 2024-06-11T16:01:01.499 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4165 4.1 4:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3056042799999998, 2024-06-11T16:01:01.500 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085906853000000005, 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:01.501 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.502 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149686+0000", 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.604e-06 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149689+0000", 2024-06-11T16:01:01.503 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8619999999999999e-06 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149693+0000", 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5879999999999999e-06 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.504 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149698+0000", 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1989999999999997e-06 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229941+0000", 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080242627999999996 2024-06-11T16:01:01.505 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230081+0000", 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013980899999999999 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.506 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235591+0000", 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055101630000000002 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4171 4.5 4:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:01.507 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3055381260000001, 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086065745999999999, 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.508 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.509 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149752+0000", 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9860000000000001e-06 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.510 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149755+0000", 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7930000000000002e-06 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149759+0000", 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.511 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149764+0000", 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6940000000000003e-06 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230273+0000", 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080509163999999994 2024-06-11T16:01:01.512 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230387+0000", 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113478 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.513 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235816+0000", 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005429227 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.514 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4176 4.26 4:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3054576009999996, 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088072037000000006, 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.515 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.516 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149833+0000", 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.069e-06 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.517 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149835+0000", 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.951e-06 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149840+0000", 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9219999999999996e-06 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.518 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149845+0000", 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3680000000000001e-06 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231857+0000", 2024-06-11T16:01:01.519 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082011375999999997 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231964+0000", 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107586 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.520 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237903+0000", 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059387650000000004 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4179 4.e 4:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.521 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3053862689999995, 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088128012000000006, 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.522 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.523 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149904+0000", 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6249999999999999e-06 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.524 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149907+0000", 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.05e-06 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149912+0000", 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7010000000000004e-06 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.525 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149917+0000", 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.682e-06 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232169+0000", 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082251357999999997 2024-06-11T16:01:01.526 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232315+0000", 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000146236 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.527 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238030+0000", 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057153600000000001 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.528 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4180 4.1 4:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3053644289999999, 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085857708000000005, 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.529 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:01.530 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149926+0000", 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.674e-06 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.531 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149928+0000", 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3719999999999999e-06 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149933+0000", 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6879999999999998e-06 2024-06-11T16:01:01.532 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149937+0000", 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6210000000000003e-06 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.533 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231335+0000", 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081397894999999998 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231401+0000", 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5963999999999994e-05 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.534 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235782+0000", 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043804940000000004 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.535 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4183 4.3e 4:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3052975309999999, 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087979063999999996, 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.536 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.537 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149993+0000", 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0480000000000001e-06 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.538 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149996+0000", 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.576e-06 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150001+0000", 2024-06-11T16:01:01.539 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1139999999999997e-06 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150006+0000", 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2259999999999996e-06 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.540 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232531+0000", 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082525077000000002 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232593+0000", 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2198000000000003e-05 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.541 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237970+0000", 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005376825 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.542 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4189 4.6 4:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3051763689999998, 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087910825999999997, 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.543 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.544 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150114+0000", 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.564e-06 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.545 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150116+0000", 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2309999999999999e-06 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150120+0000", 2024-06-11T16:01:01.546 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4349999999999999e-06 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150125+0000", 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1000000000000003e-06 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.547 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232777+0000", 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082651599000000006 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232833+0000", 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5556999999999997e-05 2024-06-11T16:01:01.548 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238023+0000", 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051903399999999999 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.549 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4194 4.2e 4:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.305089647, 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087945208999999996, 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.550 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.551 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150200+0000", 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.669e-06 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.552 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150203+0000", 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0600000000000002e-06 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150207+0000", 2024-06-11T16:01:01.553 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.578e-06 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150213+0000", 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.554 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232942+0000", 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082729331000000003 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233048+0000", 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105846 2024-06-11T16:01:01.555 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238144+0000", 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0050960739999999999 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.556 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4200 4.13 4:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.304844611, 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087359823000000003, 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.557 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150446+0000", 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7549999999999999e-06 2024-06-11T16:01:01.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150448+0000", 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.136e-06 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150453+0000", 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9139999999999999e-06 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150458+0000", 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1120000000000004e-06 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.561 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231308+0000", 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080850147999999997 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231694+0000", 2024-06-11T16:01:01.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000386334 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237804+0000", 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061094239999999996 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.563 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4212 4.13 4:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.304609117, 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087232062999999999, 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.564 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.565 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150681+0000", 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.903e-06 2024-06-11T16:01:01.566 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150684+0000", 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5749999999999999e-06 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150689+0000", 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.843e-06 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150693+0000", 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3159999999999998e-06 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231916+0000", 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081222630000000004 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232010+0000", 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4808000000000004e-05 2024-06-11T16:01:01.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237911+0000", 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059009880000000002 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4213 4.33 4:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3045900589999997, 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087147416000000005, 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.571 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150700+0000", 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5379999999999999e-06 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150702+0000", 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.761e-06 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150706+0000", 2024-06-11T16:01:01.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150711+0000", 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3789999999999997e-06 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231878+0000", 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081166901 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231978+0000", 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9943000000000002e-05 2024-06-11T16:01:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237846+0000", 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058674679999999998 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.577 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4214 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3045716289999998, 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087237145000000002, 2024-06-11T16:01:01.578 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.579 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150718+0000", 2024-06-11T16:01:01.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3939999999999999e-06 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150720+0000", 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.968e-06 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150725+0000", 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150729+0000", 2024-06-11T16:01:01.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3619999999999999e-06 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232268+0000", 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081539434999999993 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232367+0000", 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8278999999999999e-05 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237954+0000", 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055872810000000004 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.584 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4219 4.36 4:6fe38dc2:::100000001f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3044751860000003, 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087259935999999996, 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.585 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150815+0000", 2024-06-11T16:01:01.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.353e-06 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150816+0000", 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.843e-06 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150821+0000", 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3080000000000001e-06 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150826+0000", 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3550000000000004e-06 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233020+0000", 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082193980999999999 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233076+0000", 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5577e-05 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238073+0000", 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049975189999999997 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.591 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4220 4.19 4:997b7129:::100000001f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 4.3044560179999998, 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087078016999999994, 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:01.592 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150833+0000", 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.034e-06 2024-06-11T16:01:01.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150836+0000", 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2359999999999999e-06 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:01.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150840+0000", 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5759999999999999e-06 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150845+0000", 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7679999999999999e-06 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231518+0000", 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080672819000000007 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231691+0000", 2024-06-11T16:01:01.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017314300000000001 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237910+0000", 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006219441 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.598 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.599 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.599 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:01.599 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:01.599 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:01.600 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:01:01.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.601+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:01.702+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:01.708 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:01:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:01:01.709 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:01.717 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:01:01.802 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:01.802+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:01.865 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:01:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:01:01.865 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:01:01.865 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:01.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:01:01.902 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:01.902+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:01.982 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:01.982 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:01:01.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:01:01.982 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.792488254999999, 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:01.983 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:01.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:01.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:01:01.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:01.990 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.785530491999999, 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:01.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:01:01.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:01.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:01:01.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:01.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714974954999999, 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:01.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:01:02.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:01:02.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:01:02.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.005 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714928772, 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.006 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:01:02.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:01:02.013 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714910546999999, 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:01:02.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.020 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714877631, 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:01:02.021 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:01:02.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:01:02.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714855595, 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.029 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:01:02.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:01:02.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:01:02.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:02.036 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714746106, 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:01:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:01:02.043 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714697929, 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:01:02.044 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:02.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:01:02.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:01:02.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:01:02.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.7145005, 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.052 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:01:02.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:01:02.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:01:02.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.059 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714469143999999, 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:02.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:01:02.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:01:02.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:01:02.066 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714442231, 2024-06-11T16:01:02.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:01:02.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:01:02.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714308953, 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.075 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:01:02.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.71427997, 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:01:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:01:02.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:01:02.090 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.714242546000001, 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:01:02.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.097 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.713780836000002, 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:01:02.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:01:02.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:01:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.713039626, 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:01:02.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.712994718000001, 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:01:02.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:01:02.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:01:02.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.712594023000001, 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.121 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:01:02.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:01:02.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:02.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.712467066999999, 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:02.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:01:02.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:01:02.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:01:02.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:02.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:02.136 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:02.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:02.138+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:02.138 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:01:02.238 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.238+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.246 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:02.247 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:01:02.247 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:01:02.247 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:02.255 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:01:02.341 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.341+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.401 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:02.402 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:01:02.402 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:01:02.402 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:01:02.402 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:02.410 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:01:02.451 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.451+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.540 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.540+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.556 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:02.556 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 20, 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 600, 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [ 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4142 4.13 4:caba0c50:::100000001aa.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4074289970000002, 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085895401999999996, 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.557 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.558 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.559 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149265+0000", 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 8.8000000000000004e-07 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149267+0000", 2024-06-11T16:01:02.560 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9599999999999999e-06 2024-06-11T16:01:02.561 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149272+0000", 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7199999999999997e-06 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.562 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149277+0000", 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2719999999999997e-06 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229796+0000", 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080518295000000004 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.563 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229915+0000", 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000119202 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235160+0000", 2024-06-11T16:01:02.564 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0052450730000000003 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4145 4.13 4:c8b8e906:::100000001ad.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:02.565 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4073766980000002, 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085960287999999996, 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.566 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149317+0000", 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.567 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149318+0000", 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.212e-06 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149325+0000", 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 7.2400000000000001e-06 2024-06-11T16:01:02.568 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149330+0000", 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4870000000000004e-06 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149335+0000", 2024-06-11T16:01:02.569 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8690000000000003e-06 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230377+0000", 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081042760000000005 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.570 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230479+0000", 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000101326 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235277+0000", 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0047983940000000001 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.571 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4149 4.1d 4:bafada3d:::100000001b1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4073102689999999, 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085887396000000005, 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.572 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.573 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149383+0000", 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149384+0000", 2024-06-11T16:01:02.574 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2470000000000001e-06 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149386+0000", 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9819999999999998e-06 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.575 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149392+0000", 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1030000000000001e-06 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149396+0000", 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.515e-06 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.576 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229461+0000", 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080064769999999993 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229560+0000", 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9191999999999995e-05 2024-06-11T16:01:02.577 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235271+0000", 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057105869999999996 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.578 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4156 4.d 4:b3fa8219:::100000001b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.407188734, 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085877036000000004, 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.579 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149505+0000", 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.580 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149506+0000", 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.2950000000000001e-06 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.581 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149508+0000", 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.765e-06 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149512+0000", 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.582 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149517+0000", 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8550000000000001e-06 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.583 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229148+0000", 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.079630834999999997 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229251+0000", 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000102599 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.584 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235382+0000", 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061312830000000004 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.585 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4157 4.2d 4:b7eb2f66:::100000001b9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4071708320000003, 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086053058000000002, 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.586 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149523+0000", 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.587 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149524+0000", 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.3200000000000003e-07 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149525+0000", 2024-06-11T16:01:02.588 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6649999999999999e-06 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149530+0000", 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.8369999999999996e-06 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.589 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149535+0000", 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4880000000000001e-06 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230046+0000", 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080511451999999997 2024-06-11T16:01:02.590 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230145+0000", 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8655999999999999e-05 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.591 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235576+0000", 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0054310280000000001 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4158 4.36 4:6d15073c:::100000001ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.592 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4071537020000005, 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086091775999999995, 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.593 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149540+0000", 2024-06-11T16:01:02.594 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149541+0000", 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.5900000000000005e-07 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.595 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149543+0000", 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.934e-06 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149547+0000", 2024-06-11T16:01:02.596 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4750000000000004e-06 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149552+0000", 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5199999999999999e-06 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.597 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.598 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230647+0000", 2024-06-11T16:01:02.598 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081095709000000002 2024-06-11T16:01:02.598 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.598 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.598 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.599 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230759+0000", 2024-06-11T16:01:02.599 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000111634 2024-06-11T16:01:02.599 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.600 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.600 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.600 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235632+0000", 2024-06-11T16:01:02.600 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0048725449999999998 2024-06-11T16:01:02.601 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.601 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.601 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.601 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.602 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.602 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4165 4.1 4:823476fa:::100000001c1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.602 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:02.603 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4070093569999997, 2024-06-11T16:01:02.603 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085906853000000005, 2024-06-11T16:01:02.603 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.603 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.604 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.604 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.604 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.604 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.605 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:02.605 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.605 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.606 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.606 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.606 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149684+0000", 2024-06-11T16:01:02.606 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.607 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.607 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.607 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.608 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149686+0000", 2024-06-11T16:01:02.608 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.604e-06 2024-06-11T16:01:02.608 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.608 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.609 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.609 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149689+0000", 2024-06-11T16:01:02.609 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.8619999999999999e-06 2024-06-11T16:01:02.609 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.610 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.610 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.610 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149693+0000", 2024-06-11T16:01:02.611 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5879999999999999e-06 2024-06-11T16:01:02.611 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.611 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.611 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.612 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149698+0000", 2024-06-11T16:01:02.612 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1989999999999997e-06 2024-06-11T16:01:02.612 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.612 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.613 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.613 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.229941+0000", 2024-06-11T16:01:02.613 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080242627999999996 2024-06-11T16:01:02.614 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.614 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.614 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.614 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230081+0000", 2024-06-11T16:01:02.615 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00013980899999999999 2024-06-11T16:01:02.615 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.615 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.616 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.616 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235591+0000", 2024-06-11T16:01:02.616 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055101630000000002 2024-06-11T16:01:02.616 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.617 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.617 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.617 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.617 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.618 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4171 4.5 4:a07eb451:::100000001c7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.618 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:02.618 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.406943203, 2024-06-11T16:01:02.619 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.086065745999999999, 2024-06-11T16:01:02.619 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.619 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.619 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.620 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.620 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.620 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.620 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:02.621 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.621 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.621 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.622 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.622 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149750+0000", 2024-06-11T16:01:02.622 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.622 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.623 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.623 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.623 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149752+0000", 2024-06-11T16:01:02.624 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.9860000000000001e-06 2024-06-11T16:01:02.624 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.624 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.624 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.625 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149755+0000", 2024-06-11T16:01:02.625 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.7930000000000002e-06 2024-06-11T16:01:02.625 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.625 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.626 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.626 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149759+0000", 2024-06-11T16:01:02.626 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4039999999999997e-06 2024-06-11T16:01:02.627 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.627 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.627 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.627 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149764+0000", 2024-06-11T16:01:02.628 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6940000000000003e-06 2024-06-11T16:01:02.628 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.628 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.628 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.629 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230273+0000", 2024-06-11T16:01:02.629 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080509163999999994 2024-06-11T16:01:02.629 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.630 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.630 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.630 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.230387+0000", 2024-06-11T16:01:02.630 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000113478 2024-06-11T16:01:02.631 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.631 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.631 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.631 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235816+0000", 2024-06-11T16:01:02.632 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005429227 2024-06-11T16:01:02.632 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.632 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.633 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.633 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.633 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.633 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4176 4.26 4:65df6efc:::100000001cc.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.634 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:02.634 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4068626779999995, 2024-06-11T16:01:02.634 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088072037000000006, 2024-06-11T16:01:02.634 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.635 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.635 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.635 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.636 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.636 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.636 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:02.636 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.637 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.637 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.637 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.637 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149831+0000", 2024-06-11T16:01:02.638 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.638 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.638 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.639 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.639 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149833+0000", 2024-06-11T16:01:02.639 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.069e-06 2024-06-11T16:01:02.639 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.640 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.640 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.640 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149835+0000", 2024-06-11T16:01:02.640 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.951e-06 2024-06-11T16:01:02.641 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.641 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.641 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.642 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149840+0000", 2024-06-11T16:01:02.642 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9219999999999996e-06 2024-06-11T16:01:02.642 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.642 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.643 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.643 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149845+0000", 2024-06-11T16:01:02.643 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3680000000000001e-06 2024-06-11T16:01:02.643 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.644 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.644 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.644 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231857+0000", 2024-06-11T16:01:02.645 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082011375999999997 2024-06-11T16:01:02.645 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.645 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.645 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.646 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231964+0000", 2024-06-11T16:01:02.646 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000107586 2024-06-11T16:01:02.646 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.646 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.647 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.647 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237903+0000", 2024-06-11T16:01:02.647 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059387650000000004 2024-06-11T16:01:02.647 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.648 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.648 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.648 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.649 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.649 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4179 4.e 4:71d3c486:::100000001cf.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.649 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:02.649 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4067913460000003, 2024-06-11T16:01:02.650 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.088128012000000006, 2024-06-11T16:01:02.650 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.650 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149902+0000", 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149904+0000", 2024-06-11T16:01:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.6249999999999999e-06 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149907+0000", 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 3.05e-06 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149912+0000", 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7010000000000004e-06 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149917+0000", 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.682e-06 2024-06-11T16:01:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232169+0000", 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082251357999999997 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232315+0000", 2024-06-11T16:01:02.655 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000146236 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238030+0000", 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0057153600000000001 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4180 4.1 4:81350243:::100000001d0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4067695059999998, 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.085857708000000005, 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.658 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149924+0000", 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149926+0000", 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.674e-06 2024-06-11T16:01:02.659 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149928+0000", 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.3719999999999999e-06 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.660 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149933+0000", 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6879999999999998e-06 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149937+0000", 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.6210000000000003e-06 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.661 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231335+0000", 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081397894999999998 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.662 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231401+0000", 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.5963999999999994e-05 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.235782+0000", 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0043804940000000004 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.663 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4183 4.3e 4:7c32b2c0:::100000001d3.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4067026079999998, 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087979063999999996, 2024-06-11T16:01:02.664 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.665 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149991+0000", 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.666 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149993+0000", 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0480000000000001e-06 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.149996+0000", 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.576e-06 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.667 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150001+0000", 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1139999999999997e-06 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150006+0000", 2024-06-11T16:01:02.668 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.2259999999999996e-06 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232531+0000", 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082525077000000002 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.669 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232593+0000", 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 6.2198000000000003e-05 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237970+0000", 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.005376825 2024-06-11T16:01:02.670 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4189 4.6 4:61ce4130:::100000001d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4065814459999997, 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087910825999999997, 2024-06-11T16:01:02.671 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.672 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150112+0000", 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.673 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150114+0000", 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.564e-06 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150116+0000", 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2309999999999999e-06 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150120+0000", 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4349999999999999e-06 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150125+0000", 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1000000000000003e-06 2024-06-11T16:01:02.675 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232777+0000", 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082651599000000006 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.676 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232833+0000", 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5556999999999997e-05 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238023+0000", 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0051903399999999999 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.677 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4194 4.2e 4:77eaaa70:::100000001de.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4064947239999999, 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087945208999999996, 2024-06-11T16:01:02.678 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150199+0000", 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150200+0000", 2024-06-11T16:01:02.680 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.669e-06 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150203+0000", 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.0600000000000002e-06 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.681 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150207+0000", 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.578e-06 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150213+0000", 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.6509999999999998e-06 2024-06-11T16:01:02.682 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232942+0000", 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082729331000000003 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233048+0000", 2024-06-11T16:01:02.683 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000105846 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238144+0000", 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0050960739999999999 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.684 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4200 4.13 4:c88cf2e1:::100000001e4.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4062496879999999, 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087359823000000003, 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.685 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.686 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150444+0000", 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150446+0000", 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.7549999999999999e-06 2024-06-11T16:01:02.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150448+0000", 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.136e-06 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.688 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150453+0000", 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.9139999999999999e-06 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150458+0000", 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.1120000000000004e-06 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.689 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231308+0000", 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080850147999999997 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231694+0000", 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.000386334 2024-06-11T16:01:02.690 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237804+0000", 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0061094239999999996 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4212 4.13 4:ca7e1ea4:::100000001f0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4060141939999999, 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087232062999999999, 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.692 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.693 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150679+0000", 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150681+0000", 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.903e-06 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150684+0000", 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.5749999999999999e-06 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150689+0000", 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.843e-06 2024-06-11T16:01:02.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150693+0000", 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3159999999999998e-06 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.696 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231916+0000", 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081222630000000004 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232010+0000", 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.4808000000000004e-05 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.697 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237911+0000", 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0059009880000000002 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4213 4.33 4:ce8ed050:::100000001f1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4059951359999996, 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087147416000000005, 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.699 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150698+0000", 2024-06-11T16:01:02.700 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150700+0000", 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.5379999999999999e-06 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.701 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150702+0000", 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.761e-06 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150706+0000", 2024-06-11T16:01:02.702 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150711+0000", 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3789999999999997e-06 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.703 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231878+0000", 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081166901 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231978+0000", 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.9943000000000002e-05 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.704 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237846+0000", 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0058674679999999998 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4214 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.705 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4059767059999997, 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087237145000000002, 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.706 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150717+0000", 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.707 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150718+0000", 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.3939999999999999e-06 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150720+0000", 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.968e-06 2024-06-11T16:01:02.708 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150725+0000", 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.4259999999999996e-06 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150729+0000", 2024-06-11T16:01:02.709 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3619999999999999e-06 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232268+0000", 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.081539434999999993 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.710 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.232367+0000", 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 9.8278999999999999e-05 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237954+0000", 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0055872810000000004 2024-06-11T16:01:02.711 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4219 4.36 4:6fe38dc2:::100000001f7.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4058802630000002, 2024-06-11T16:01:02.712 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087259935999999996, 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.713 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150813+0000", 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.714 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150815+0000", 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.353e-06 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150816+0000", 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.843e-06 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.715 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150821+0000", 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.3080000000000001e-06 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150826+0000", 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.3550000000000004e-06 2024-06-11T16:01:02.716 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233020+0000", 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.082193980999999999 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.233076+0000", 2024-06-11T16:01:02.717 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 5.5577e-05 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.238073+0000", 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.0049975189999999997 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.718 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "description": "osd_op(mds.0.3:4220 4.19 4:997b7129:::100000001f8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "initiated_at": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "age": 5.4058610949999997, 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.087078016999999994, 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "continuous": false, 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "type_data": { 2024-06-11T16:01:02.719 INFO:teuthology.orchestra.run.smithi129.stdout: "flag_point": "started", 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "events": [ 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "initiated", 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "header_read", 2024-06-11T16:01:02.720 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150832+0000", 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "throttled", 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150833+0000", 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 1.034e-06 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.721 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "all_read", 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150836+0000", 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 2.2359999999999999e-06 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "dispatched", 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150840+0000", 2024-06-11T16:01:02.722 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.5759999999999999e-06 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "queued_for_pg", 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.150845+0000", 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 4.7679999999999999e-06 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "reached_pg", 2024-06-11T16:01:02.723 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231518+0000", 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.080672819000000007 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "started", 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.231691+0000", 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.00017314300000000001 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: { 2024-06-11T16:01:02.724 INFO:teuthology.orchestra.run.smithi129.stdout: "event": "done", 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: "time": "2024-06-11T16:00:57.237910+0000", 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: "duration": 0.006219441 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2024-06-11T16:01:02.725 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:02.727 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:01:02.727 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.726+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.828 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.828+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.833 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:02.833 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:01:02.834 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-06-11T16:01:02.834 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:02.843 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:01:02.928 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:02.929+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:02.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:01:02.949 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-06-11T16:01:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-06-11T16:01:02.949 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-06-11T16:01:02.949 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:02.958 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:01:03.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.030+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.065 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-06-11T16:01:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-06-11T16:01:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-06-11T16:01:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:30 4.1b e55/43 4:d9872866:::1000000021d.00000002:head v 55'1, mlcod=0'0)", 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.875686275, 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012976272000000001, 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.189462+0000", 2024-06-11T16:01:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9200000000000001e-07 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192878+0000", 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034155449999999999 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192890+0000", 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2537999999999999e-05 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192898+0000", 2024-06-11T16:01:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6229999999999997e-06 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192973+0000", 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5337000000000001e-05 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.192991+0000", 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7350000000000002e-05 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202403+0000", 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0094121580000000003 2024-06-11T16:01:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.202438+0000", 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5129000000000002e-05 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(client.14414.0:31 4.31 e55/43 4:8ebfc112:::1000000021d.00000001:head v 55'1, mlcod=0'0)", 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.868728512000001, 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013623428999999999, 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196419+0000", 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.196420+0000", 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2600000000000002e-07 2024-06-11T16:01:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200247+0000", 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003826599 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200260+0000", 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2934e-05 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200267+0000", 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3250000000000002e-06 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200317+0000", 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9771999999999997e-05 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.200333+0000", 2024-06-11T16:01:03.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6416e-05 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.209993+0000", 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0096600950000000005 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:32.210043+0000", 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9662e-05 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1033 4.1a e59/43 4:5ab3dd8f:::100000003bd.00000000:head v 59'107, mlcod=59'105)", 2024-06-11T16:01:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.798172975, 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01307357, 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266975+0000", 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6499999999999999e-07 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266985+0000", 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.266995+0000", 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0662000000000001e-05 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267000+0000", 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3830000000000002e-06 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-06-11T16:01:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267066+0000", 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7382999999999999e-05 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268238+0000", 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011720610000000001 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011810325 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1034 4.29 e59/43 4:96aa9846:::100000003bf.00000000:head v 59'114, mlcod=59'112)", 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.798126792000001, 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013949058, 2024-06-11T16:01:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267021+0000", 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.22e-07 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267024+0000", 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3889999999999999e-06 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267029+0000", 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8250000000000004e-06 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267032+0000", 2024-06-11T16:01:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.241e-06 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267068+0000", 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6294000000000002e-05 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267086+0000", 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7397999999999998e-05 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280937+0000", 2024-06-11T16:01:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013851743999999999 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280970+0000", 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2845000000000001e-05 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1036 4.1d e59/43 4:bb2af69d:::100000003c3.00000000:head v 59'104, mlcod=59'102)", 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.798108567, 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013437007000000001, 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267039+0000", 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267040+0000", 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8400000000000001e-07 2024-06-11T16:01:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267049+0000", 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0599999999999997e-06 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267057+0000", 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5730000000000008e-06 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267061+0000", 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1330000000000001e-06 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267100+0000", 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8986000000000002e-05 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267119+0000", 2024-06-11T16:01:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9074000000000001e-05 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268117+0000", 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00099777900000000007 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280476+0000", 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012359218 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1037 4.a e59/43 4:52da5114:::100000003c5.00000000:head v 59'109, mlcod=58'107)", 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.798075651000001, 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013005881, 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267072+0000", 2024-06-11T16:01:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267073+0000", 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8500000000000002e-07 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267076+0000", 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1039999999999998e-06 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267082+0000", 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.015e-06 2024-06-11T16:01:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267087+0000", 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267286+0000", 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000198426 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6079e-05 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280051+0000", 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012749030999999999 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280078+0000", 2024-06-11T16:01:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7195e-05 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1031 4.2e e59/33 4:7427c9c1:::100000003b9.00000000:head v 59'103, mlcod=59'100)", 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.798053615000001, 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013368296, 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267094+0000", 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267095+0000", 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9799999999999999e-07 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267097+0000", 2024-06-11T16:01:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.762e-06 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267103+0000", 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7409999999999998e-06 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267107+0000", 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2470000000000002e-06 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267163+0000", 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5868000000000001e-05 2024-06-11T16:01:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267180+0000", 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6801000000000001e-05 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280420+0000", 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013239969000000001 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280463+0000", 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.261e-05 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1043 4.31 e59/43 4:8ca9c0f7:::100000003cf.00000000:head v 59'112, mlcod=59'110)", 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797944126000001, 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013797034, 2024-06-11T16:01:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267204+0000", 2024-06-11T16:01:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1600000000000001e-07 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267224+0000", 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9672000000000001e-05 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267234+0000", 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0151e-05 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267239+0000", 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1869999999999996e-06 2024-06-11T16:01:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267299+0000", 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9169999999999998e-05 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267314+0000", 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5800000000000001e-05 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280973+0000", 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013658231 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281001+0000", 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8306999999999999e-05 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1040 4.36 e59/33 4:6e6358d4:::100000003ca.00000000:head v 59'98, mlcod=58'96)", 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797895949000001, 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0132409, 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267252+0000", 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3099999999999999e-07 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267255+0000", 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1489999999999998e-06 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267262+0000", 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.19e-06 2024-06-11T16:01:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267266+0000", 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4669999999999998e-06 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267302+0000", 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5386000000000003e-05 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267316+0000", 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4260000000000001e-05 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280465+0000", 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013149137999999999 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280493+0000", 2024-06-11T16:01:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7979000000000001e-05 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1047 4.23 e59/17 4:c48a077b:::100000003dd.00000000:head v 59'113, mlcod=59'110)", 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797698520000001, 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013869869, 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267449+0000", 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267450+0000", 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4099999999999999e-07 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267454+0000", 2024-06-11T16:01:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1160000000000001e-06 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267462+0000", 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0209999999999999e-06 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267467+0000", 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.366e-06 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267529+0000", 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1713999999999999e-05 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267547+0000", 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7439999999999999e-05 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281246+0000", 2024-06-11T16:01:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013699085999999999 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281319+0000", 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3684999999999997e-05 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1044 4.6 e59/24 4:6245a6e4:::100000003d7.00000000:head v 59'107, mlcod=59'104)", 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797667164, 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013040809, 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267481+0000", 2024-06-11T16:01:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267484+0000", 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2320000000000001e-06 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267492+0000", 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8990000000000001e-06 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267497+0000", 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3420000000000001e-06 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267532+0000", 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5605999999999998e-05 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267549+0000", 2024-06-11T16:01:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6691e-05 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280494+0000", 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012945596 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280522+0000", 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7121999999999999e-05 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1045 4.39 e59/43 4:9de7aaaf:::100000003d9.00000000:head v 59'119, mlcod=58'116)", 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797640251000001, 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013529302, 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267508+0000", 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.96e-07 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267515+0000", 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9079999999999998e-06 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267521+0000", 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-06-11T16:01:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267526+0000", 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2259999999999999e-06 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267559+0000", 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3609999999999998e-05 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267575+0000", 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6104e-05 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281002+0000", 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013427074000000001 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281037+0000", 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4644000000000002e-05 2024-06-11T16:01:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1046 4.29 e59/43 4:94bd1b8e:::100000003db.00000000:head v 59'115, mlcod=59'112)", 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797506973000001, 2024-06-11T16:01:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013959868, 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267641+0000", 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267642+0000", 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267645+0000", 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8979999999999998e-06 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267653+0000", 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7929999999999998e-06 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267659+0000", 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3809999999999998e-06 2024-06-11T16:01:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280024+0000", 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012365543999999999 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280050+0000", 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5732e-05 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281469+0000", 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0014192199999999999 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281601+0000", 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176400000000001 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1048 4.2d e59/17 4:b51477c9:::100000003df.00000000:head v 59'103, mlcod=59'101)", 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797477990000001, 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.020344609, 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267670+0000", 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3099999999999999e-07 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267673+0000", 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.683e-06 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267679+0000", 2024-06-11T16:01:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.037e-06 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267688+0000", 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2790000000000004e-06 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280844+0000", 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013155404000000001 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280865+0000", 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1328e-05 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287712+0000", 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068473650000000002 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.288015+0000", 2024-06-11T16:01:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00030228200000000002 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1049 4.23 e59/17 4:c6336b30:::100000003e1.00000000:head v 59'114, mlcod=59'110)", 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.797440565999999, 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013730874000000001, 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267707+0000", 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267708+0000", 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2099999999999998e-07 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267711+0000", 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1439999999999999e-06 2024-06-11T16:01:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267717+0000", 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2720000000000003e-06 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.267722+0000", 2024-06-11T16:01:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2480000000000004e-06 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280029+0000", 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012306569999999999 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280049+0000", 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0466999999999999e-05 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281321+0000", 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0012720489999999999 2024-06-11T16:01:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281438+0000", 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116803 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1050 4.1b e59/43 4:da1207b9:::100000003e3.00000000:head v 59'112, mlcod=58'110)", 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.796978855999999, 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019822558000000001, 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268169+0000", 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268170+0000", 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-06-11T16:01:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268174+0000", 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1969999999999998e-06 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268182+0000", 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8529999999999992e-06 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268187+0000", 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7370000000000003e-06 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280581+0000", 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012393563999999999 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280735+0000", 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000153869 2024-06-11T16:01:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287665+0000", 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069301620000000001 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.287992+0000", 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00032671499999999999 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1051 4.7 e59/17 4:e3b32bf4:::100000003e5.00000000:head v 59'116, mlcod=58'113)", 2024-06-11T16:01:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.796237646000002, 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015558269, 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268910+0000", 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268911+0000", 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8400000000000003e-07 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268918+0000", 2024-06-11T16:01:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0550000000000002e-06 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268927+0000", 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2110000000000004e-06 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268933+0000", 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5890000000000002e-06 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280034+0000", 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011100887 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280054+0000", 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0115e-05 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284432+0000", 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0043778890000000003 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284469+0000", 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6638999999999999e-05 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1052 4.2f e59/17 4:f739814c:::100000003e7.00000000:head v 59'109, mlcod=59'106)", 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.796192737999998, 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015616748, 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268955+0000", 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268956+0000", 2024-06-11T16:01:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8599999999999997e-07 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268961+0000", 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.994e-06 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268969+0000", 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9049999999999997e-06 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.268974+0000", 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.147e-06 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280103+0000", 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011128783 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280861+0000", 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00075851200000000003 2024-06-11T16:01:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284530+0000", 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036686919999999999 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.284572+0000", 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1829000000000002e-05 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop(mds.0.3:1054 4.20 e59/43 4:05f2e7f5:::100000003eb.00000000:head v 59'128, mlcod=59'126)", 2024-06-11T16:01:03.203 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.795792042999999, 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012136351, 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269356+0000", 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269357+0000", 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2899999999999999e-06 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269380+0000", 2024-06-11T16:01:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2368e-05 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269395+0000", 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5699999999999999e-05 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269402+0000", 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6499999999999999e-06 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280245+0000", 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010842945999999999 2024-06-11T16:01:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280263+0000", 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7980000000000001e-05 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281450+0000", 2024-06-11T16:01:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0011876689999999999 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281492+0000", 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1748000000000001e-05 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1064 4.24 4:262964af:::100000003fd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.795665087, 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012155849, 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-06-11T16:01:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269483+0000", 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269484+0000", 2024-06-11T16:01:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.581e-06 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269489+0000", 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.121e-06 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269500+0000", 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.102e-05 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.269507+0000", 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.985e-06 2024-06-11T16:01:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280041+0000", 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010534566 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.280157+0000", 2024-06-11T16:01:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116371 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281535+0000", 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001377166 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281565+0000", 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0091e-05 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-06-11T16:00:40.281639+0000", 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3948000000000004e-05 2024-06-11T16:01:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-06-11T16:01:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-06-11T16:01:03.219 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-06-11T16:01:03.221 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-06-11T16:01:03.221 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:03.221+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:03.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.323+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.331 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:03.331 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:01:03.331 INFO:teuthology.orchestra.run.smithi129.stdout: "num_ops": 0 2024-06-11T16:01:03.331 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:03.340 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-06-11T16:01:03.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-06-11T16:01:03.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.424+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.444 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-06-11T16:01:03.444 INFO:teuthology.orchestra.run.smithi129.stdout: "ops": [], 2024-06-11T16:01:03.444 INFO:teuthology.orchestra.run.smithi129.stdout: "complaint_time": 30, 2024-06-11T16:01:03.444 INFO:teuthology.orchestra.run.smithi129.stdout: "num_blocked_ops": 0 2024-06-11T16:01:03.444 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-06-11T16:01:03.453 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-06-11T16:01:03.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.525+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.526 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0: {} 2024-06-11T16:01:03.527 INFO:teuthology.orchestra.run.smithi089.stderr:osd.0: osd_enable_op_tracker = '' 2024-06-11T16:01:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1: {} 2024-06-11T16:01:03.544 INFO:teuthology.orchestra.run.smithi089.stderr:osd.1: osd_enable_op_tracker = '' 2024-06-11T16:01:03.544 INFO:teuthology.orchestra.run.smithi089.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-06-11T16:01:03.547 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-06-11T16:01:03.548 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-06-11T16:01:03.557 INFO:teuthology.orchestra.run.smithi129.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:03.557 INFO:teuthology.orchestra.run.smithi129.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:03.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-06-11T16:01:03.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.626+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.684 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:03.684 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:03.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-06-11T16:01:03.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T16:01:03.690 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-11T16:01:03.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-06-11T16:01:03.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T16:01:03.705 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-06-11T16:01:03.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.735+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.760 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-11T16:01:03.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T16:01:03.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-11T16:01:03.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-11T16:01:03.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-06-11T16:01:03.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2024-06-11T16:01:03.828+0000 7fd42708c640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31729) UID: 0 2024-06-11T16:01:03.839 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:03.839 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:03.848 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-06-11T16:01:03.923 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:01:03.928 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-06-11T16:01:03.938 INFO:tasks.thrashosds:joining thrashosds 2024-06-11T16:01:03.938 INFO:tasks.ceph.osd.0.smithi129.stderr:2024-06-11T16:01:03.928+0000 7f88eb5e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31818) UID: 0 2024-06-11T16:01:03.995 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-06-11T16:01:03.995 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-06-11T16:01:05.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-06-11T16:01:05.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-06-11T16:01:06.921 INFO:teuthology.orchestra.run.smithi089.stderr:noscrub is unset 2024-06-11T16:01:06.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-06-11T16:01:07.933 INFO:teuthology.orchestra.run.smithi089.stderr:nodeep-scrub is unset 2024-06-11T16:01:11.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-06-11T16:01:17.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-06-11T16:01:23.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-06-11T16:01:29.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-06-11T16:01:34.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-06-11T16:01:40.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2024-06-11T16:01:46.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-06-11T16:01:52.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-06-11T16:01:58.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-06-11T16:02:03.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-06-11T16:02:09.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~128s 2024-06-11T16:02:15.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~134s 2024-06-11T16:02:21.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-06-11T16:02:27.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2024-06-11T16:02:32.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-06-11T16:02:38.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2024-06-11T16:02:44.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~163s 2024-06-11T16:02:50.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~169s 2024-06-11T16:02:51.406 DEBUG:teuthology.orchestra.console.smithi171:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Cthe Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6F 6D GUID: 00000000 0000 0000 0000 0CC47AD939A2 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.171 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.171 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6f:6d)... Configuring (net0 0c:c4:7a:88:6f:6d).... Configuring (net0 0c:c4:7a:88:6f:6d)..... Configuring (net0 0c:c4:7a:88:6f:6d)...... ok .    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-452.el9.x86_64) 9  CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-452.el9.x86_64) 9   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9          The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h        [ 0.000000] Linux version 5.14.0-452.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Sat May 18 20:39:48 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical 0.000000] BI0000000000000-0xusable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.717 MHz processor [ 0.000398] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000402] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000404] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000733] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006376] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006384] Using GB pages for direct mapping [ 0.006485] RAMDISK: [mem 0x342bc000-0x36155fff] [ 0.006487] ACPI: Early table checksum verification disabled [ 0.006489] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006492] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006497] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006501] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006504] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006506] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006508] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006510] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006512] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006514] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006517] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006519] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006521] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006523] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006526] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006528] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006530] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006532] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006535] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006537] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006539] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006541] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006544] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006545] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006546] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006547] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006548] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006548] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006549] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006550] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006550] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006551] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006551] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006552] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006553] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006553] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006554] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006554] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006555] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006555] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006556] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006557] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006557] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006558] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006604] No NUMA configuration found [ 0.006604] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006613] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006787] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006823] Zone ranges: [ 0.006823] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006825] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006826] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006827] Device empty [ 0.006828] Movable zone start for each node [ 0.006830] Early memory node ranges [ 0.006830] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006831] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006832] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006836] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006840] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006878] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011880] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011991] ACPI: PM-Timer IO Port: 0x408 [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012003] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012003] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012004] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012013] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012018] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012019] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012021] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012025] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012026] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012030] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012031] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012039] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012046] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012047] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012048] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012049] Booting paravirtualized kernel on bare hardware [ 0.012051] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016398] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016619] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016641] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016694] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64", will be passed to user space. [ 0.016711] random: crng init done [ 0.018896] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020042] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020148] Fallback order for Node 0: 0 [ 0.020151] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020152] Policy zone: Normal [ 0.020295] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020303] software IO TLB: area num 8. [ 0.048571] Memory: 1751980K/33438012K available (16384K kernel code, 5646K rwdata, 12096K rodata, 3944K init, 5820K bss, 987376K reserved, 0K cma-reserved) [ 0.048678] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048686] Kernel/User page tables isolation: enabled [ 0.048710] ftrace: allocating 47491 entries in 186 pages [ 0.066981] ftrace: allocated 186 pages with 5 groups [ 0.067502] Dynamic Preempt: voluntary [ 0.067530] rcu: Preemptible hierarchical RCU implementation. [ 0.067531] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067532] Trampoline variant of Tasks RCU enabled. [ 0.067533] Rude variant of Tasks RCU enabled. [ 0.067533] Tracing variant of Tasks RCU enabled. [ 0.067534] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067534] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070905] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.071067] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.071177] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076420] Console: colour VGA+ 80x25 [ 0.076437] printk: console [ttyS1] enabled [ 1.117772] ACPI: Core revision 20230331 [ 1.121865] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130995] APIC: Switch to symmetric I/O mode setup [ 1.135965] DMAR: Host address width 46 [ 1.139807] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.145125] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.153121] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.159385] DMAR: ATSR flags: 0x0 [ 1.162706] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168974] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.175326] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181680] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.187078] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.187078] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.202112] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.207414] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.213638] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.224001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327245ad07c, max_idle_ns: 440795310094 ns [ 1.234513] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.43 BogoMIPS (lpj=3499717) [ 1.235530] CPU0: Thermal monitoring enabled (TM1) [ 1.236566] process: using mwait in idle threads [ 1.237513] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.238511] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.239513] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.240512] Spectre V2 : Mitigation: Retpolines [ 1.241511] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.242511] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.243512] Speculative Store Bypass: Vulnerable [ 1.244517] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245511] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246511] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.247515] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.248511] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.249511] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.250512] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.251511] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.264122] Freeing SMP alternatives memory: 36K [ 1.264512] pid_max: default: 32768 minimum: 301 [ 1.265529] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.266516] Yama: becoming mindful. [ 1.267516] SELinux: Initializing. [ 1.268528] LSM support for eBPF active [ 1.269569] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270550] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374538] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.376597] cblist_init_generic: Setting adjustable number of callback queues. [ 1.377511] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378523] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379521] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.380520] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.381512] ... version: 3 [ 1.382511] ... bit width: 48 [ 1.383511] ... generic registers: 4 [ 1.384511] ... value mask: 0000ffffffffffff [ 1.385511] ... max period: 00007fffffffffff [ 1.386511] ... fixed-purpose events: 3 [ 1.387512] ... event mask: 000000070000000f [ 1.388595] signal: max sigframe size: 1776 [ 1.389522] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.390536] rcu: Hierarchical SRCU implementation. [ 1.390537] rcu: Max phase no-delay instances is 400. [ 1.393535] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.395564] smp: Bringing up secondary CPUs ... [ 1.396578] smpboot: x86: Booting SMP configuration: [ 1.396580] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400073] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400073] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400073] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.403551] smp: Brought up 1 node, 8 CPUs [ 1.403551] smpboot: Max logical packages: 1 [ 1.403551] smpboot: Total of 8 processors activated (55995.47 BogoMIPS) [ 1.444763] node 0 deferred pages initialised in 40ms [ 1.451419] devtmpfs: initialized [ 1.451536] x86/mm: Memory block size: 128MB [ 1.453959] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453959] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453959] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453959] pinctrl core: initialized pinctrl subsystem [ 1.477328] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.477436] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.477442] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.477445] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.477454] audit: initializing netlink subsys (disabled) [ 1.477513] audit: type=2000 audit(1718121744.263:1): state=initialized audit_enabled=0 res=1 [ 1.477572] thermal_sys: Registered thermal governor 'fair_share' [ 1.477573] thermal_sys: Registered thermal governor 'step_wise' [ 1.477574] thermal_sys: Registered thermal governor 'user_space' [ 1.483514] cpuidle: using governor menu [ 1.489542] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.489542] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.489596] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.489600] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.489611] PCI: Using configuration type 1 for base access [ 1.509549] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.509555] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.509555] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.509555] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.509555] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.518323] cryptd: max_cpu_qlen set to 1000 [ 1.518582] ACPI: Added _OSI(Module Device) [ 1.518583] ACPI: Added _OSI(Processor Device) [ 1.518584] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.518584] ACPI: Added _OSI(Processor Aggregator Device) [ 1.518585] ACPI: Added _OSI(Linux-Dell-Video) [ 1.518586] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.518586] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.541701] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.543855] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.546606] ACPI: Dynamic OEM Table Load: [ 1.560184] ACPI: _OSC evaluated successfully for all CPUs [ 1.560439] ACPI: Interpreter enabled [ 1.560449] ACPI: PM: (supports S0 S4 S5) [ 1.560450] ACPI: Using IOAPIC for interrupt routing [ 1.561902] HEST: Enabling Firmware First mode for corrected errors. [ 1.612652] HEST: Table parsing has been initialized. [ 1.612772] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.612774] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.612775] PCI: Using E820 reservations for host bridge windows [ 1.613204] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.633815] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.633820] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.634910] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.635438] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.635439] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.635465] PCI host bridge to bus 0000:ff [ 1.635466] pci_bus 0000:ff: root bus resource [bus ff] [ 1.635476] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.635522] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.635554] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.635584] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.635614] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.635643] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.635672] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.635700] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.635731] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.635759] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.635788] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.635819] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.635848] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.635879] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.635908] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.635938] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.635966] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.635994] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.636023] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.636044] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.636079] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636139] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636199] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636258] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636316] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636374] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636432] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.636478] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.636514] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636555] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636596] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636637] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636677] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.636707] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.636738] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.636768] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.636799] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636840] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636883] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636925] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636967] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.637002] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.637032] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.637065] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.637099] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.637129] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.637160] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.637190] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.637224] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.637254] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.637283] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.637313] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.637333] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.637365] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.637395] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.639597] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.639600] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.639731] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.639971] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.639972] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.640369] PCI host bridge to bus 0000:00 [ 1.640371] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.640372] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.640373] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.640374] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.640375] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.640376] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.640377] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.640397] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.640498] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.640510] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.640547] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.640638] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.640650] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.640653] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.640685] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.640773] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.640784] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.640786] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.640788] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.640792] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.640821] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.640905] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640912] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.640987] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640994] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.641067] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641074] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.641147] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641155] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.641226] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641234] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.641305] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641313] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.641384] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641392] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.641467] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641474] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.641550] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641610] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641690] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641746] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.641751] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.641830] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.642066] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.642086] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.642097] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.642108] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.642119] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.642129] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.642141] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.642199] pci 0000:00:11.4: PME# supported from D3hot [ 1.642277] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.642302] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.642389] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.642475] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.642499] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.642587] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.642655] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.642679] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.642767] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.642850] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642871] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.642986] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.643066] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.643103] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.643195] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.643292] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.643329] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.643334] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.643337] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.643428] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.643527] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.643564] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.643569] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.643572] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.643660] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.643763] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.643785] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.643901] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.643981] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.644183] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.644201] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.644212] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.644223] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.644233] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.644244] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.644254] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.644308] pci 0000:00:1f.2: PME# supported from D3hot [ 1.644369] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.644393] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.644422] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.644586] acpiphp: Slot [1] registered [ 1.644597] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.644700] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.644709] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.644726] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.644729] pci 0000:02:00.0: enabling Extended Tags [ 1.644830] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.644937] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.644948] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.644953] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.644963] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.644967] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.645003] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.645019] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645021] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.645029] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645030] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.645181] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.645191] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.645196] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.645206] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.645210] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.645246] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.645259] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645261] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.645269] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645270] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.645409] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.645454] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.645548] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.645620] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.645633] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.645638] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.645691] pci 0000:05:00.0: enabling Extended Tags [ 1.645824] pci 0000:05:00.0: supports D1 D2 [ 1.645824] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.646000] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.646088] pci_bus 0000:06: extended config space not accessible [ 1.646121] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.646158] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.646177] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.646197] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.646297] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.646367] pci 0000:06:00.0: supports D1 D2 [ 1.646368] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.646516] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.646658] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.646692] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.646728] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.646746] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.646969] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.647030] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647031] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.647067] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647068] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.647394] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.647427] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.647464] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.647482] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.647703] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.647764] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647765] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.647799] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647800] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.648097] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.648110] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.648768] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.648799] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.648830] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.648863] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.648894] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.648894] ACPI: PCI: Interrupt link LNKE disabled [ 1.648924] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.648925] ACPI: PCI: Interrupt link LNKF disabled [ 1.648955] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.648955] ACPI: PCI: Interrupt link LNKG disabled [ 1.648985] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.648985] ACPI: PCI: Interrupt link LNKH disabled [ 1.649515] iommu: Default domain type: Translated [ 1.649516] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.649592] SCSI subsystem initialized [ 1.649607] ACPI: bus type USB registered [ 1.649619] usbcore: registered new interface driver usbfs [ 1.649625] usbcore: registered new interface driver hub [ 1.649630] usbcore: registered new device driver usb [ 1.649649] pps_core: LinuxPPS API ver. 1 registered [ 1.649649] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.649652] PTP clock support registered [ 1.649666] EDAC MC: Ver: 3.0.0 [ 1.649666] NetLabel: Initializing [ 1.649666] NetLabel: domain hash size = 128 [ 1.649666] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.649666] NetLabel: unlabeled traffic allowed by default [ 1.649666] PCI: Using ACPI for IRQ routing [ 1.660532] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.660534] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.660535] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.660536] vgaarb: loaded [ 1.660540] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.660544] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.529641] clocksource: Switched to clocksource tsc-early [ 3.537363] VFS: Disk quotas dquot_6.6.0 [ 3.537375] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.537424] pnp: PnP ACPI init [ 3.537749] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.537752] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.537753] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.537754] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.537755] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.537756] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.537757] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.537759] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.537760] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.537761] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.537762] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.537763] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.537763] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.537924] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.537925] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.537926] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.537927] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.537928] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.538589] pnp: PnP ACPI: found 5 devices [ 3.544038] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.544074] NET: Registered PF_INET protocol family [ 3.544237] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.546484] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.546519] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.546531] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.546766] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.546885] TCP: Hash tables configured (established 262144 bind 65536) [ 3.547003] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.547086] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.547143] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.547224] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.547229] NET: Registered PF_XDP protocol family [ 3.547250] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.547260] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 3.547262] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.547267] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.547269] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.547275] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547276] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547278] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547279] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547280] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547281] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547282] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547283] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547284] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547285] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547286] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547287] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547289] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547289] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547291] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547291] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547293] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.547294] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.547296] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.547297] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.547300] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.547313] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.547315] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.547323] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.547339] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.547341] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.547347] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.547356] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 3.547362] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 3.547368] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 3.547375] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 3.547382] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.547384] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.547389] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.547392] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.547398] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 3.547399] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.547400] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.547401] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.547402] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.547403] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.547404] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.547405] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.547406] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.547407] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.547407] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.547409] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.547409] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.547410] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.547411] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.547412] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.547413] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.547413] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.547572] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.564555] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16417 usecs [ 3.576553] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11701 usecs [ 3.576567] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.576603] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.576604] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.576610] ACPI: bus type thunderbolt registered [ 3.576613] Trying to unpack rootfs image as initramfs... [ 3.892239] Freeing initrd memory: 31336K [ 4.237384] Initialise system trusted keyrings [ 4.237395] Key type blacklist registered [ 4.237438] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.237455] zbud: loaded [ 4.254889] integrity: Platform Keyring initialized [ 4.254893] integrity: Machine keyring initialized [ 4.262805] NET: Registered PF_ALG protocol family [ 4.262807] xor: automatically using best checksumming function avx [ 4.262808] Key type asymmetric registered [ 4.262809] Asymmetric key parser 'x509' registered [ 4.262809] Running certificate verification selftests [ 4.264497] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 4.264975] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 4.265004] io scheduler mq-deadline registered [ 4.265005] io scheduler kyber registered [ 4.265009] io scheduler bfq registered [ 4.320644] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 4.320953] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.321107] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.321249] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.321379] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.321538] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.321683] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.321836] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.321913] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.374150] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.374171] ACPI: button: Power Button [PWRB] [ 4.374193] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.374246] ACPI: button: Power Button [PWRF] [ 4.399119] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.399123] pstore: Registered erst as persistent store backend [ 4.399227] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.399327] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.406633] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.412903] Non-volatile memory driver v1.3 [ 4.437752] rdac: device handler registered [ 4.437776] hp_sw: device handler registered [ 4.437777] emc: device handler registered [ 4.437794] alua: device handler registered [ 4.438066] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.438102] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 4.438116] ehci-pci 0000:00:1d.0: debug port 2 [ 4.442029] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.448544] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.448575] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.448577] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.448578] usb usb1: Product: EHCI Host Controller [ 4.448579] usb usb1: Manufacturer: Linux 5.14.0-452.el9.x86_64 ehci_hcd [ 4.448580] usb usb1: SerialNumber: 0000:00:1d.0 [ 4.448671] hub 1-0:1.0: USB hub found [ 4.448675] hub 1-0:1.0: 2 ports detected [ 4.448799] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.448834] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 4.449920] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.450110] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.450133] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.450168] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.450169] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 4.450170] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.450188] ehci-pci 0000:00:1a.0: debug port 2 [ 4.450211] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.450213] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.450214] usb usb2: Product: xHCI Host Controller [ 4.450215] usb usb2: Manufacturer: Linux 5.14.0-452.el9.x86_64 xhci-hcd [ 4.450217] usb usb2: SerialNumber: 0000:00:14.0 [ 4.450323] hub 2-0:1.0: USB hub found [ 4.450355] hub 2-0:1.0: 15 ports detected [ 4.452933] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 4.452935] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.452937] usb usb4: Product: xHCI Host Controller [ 4.452938] usb usb4: Manufacturer: Linux 5.14.0-452.el9.x86_64 xhci-hcd [ 4.452939] usb usb4: SerialNumber: 0000:00:14.0 [ 4.453018] hub 4-0:1.0: USB hub found [ 4.453036] hub 4-0:1.0: 6 ports detected [ 4.454115] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.454194] usbcore: registered new interface driver usbserial_generic [ 4.454199] usbserial: USB Serial support registered for generic [ 4.454233] i8042: PNP: No PS/2 controller found. [ 4.454281] mousedev: PS/2 mouse device common for all mice [ 4.454336] rtc_cmos 00:00: RTC can wake from S4 [ 4.454615] rtc_cmos 00:00: registered as rtc0 [ 4.454662] rtc_cmos 00:00: setting system clock to 2024-06-11T16:02:28 UTC (1718121748) [ 4.454683] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.460546] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.460573] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.460574] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.460575] usb usb3: Product: EHCI Host Controller [ 4.460576] usb usb3: Manufacturer: Linux 5.14.0-452.el9.x86_64 ehci_hcd [ 4.460577] usb usb3: SerialNumber: 0000:00:1a.0 [ 4.460653] hub 3-0:1.0: USB hub found [ 4.460656] hub 3-0:1.0: 2 ports detected [ 4.637538] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.637543] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.772467] clocksource: Switched to clocksource tsc [ 4.772469] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.772547] intel_pstate: Intel P-state driver initializing [ 4.790382] hid: raw HID events driver (C) Jiri Kosina [ 4.790417] usbcore: registered new interface driver usbhid [ 4.790417] usbhid: USB HID core driver [ 4.790444] drop_monitor: Initializing network drop monitor service [ 4.799418] Initializing XFRM netlink socket [ 4.799436] NET: Registered PF_INET6 protocol family [ 4.804231] Segment Routing with IPv6 [ 4.804248] NET: Registered PF_PACKET protocol family [ 4.804272] mpls_gso: MPLS GSO support [ 4.823561] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 4.824552] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 4.846408] microcode: Current revision: 0x0b00001b [ 4.851452] resctrl: L3 allocation detected [ 4.851455] resctrl: L3 monitoring detected [ 4.851471] IPI shorthand broadcast: enabled [ 4.851476] AVX2 version of gcm_enc/dec engaged. [ 4.868769] AES CTR mode by8 optimization enabled [ 4.868812] sched_clock: Marking stable (3725308645, 1143415884)->(5266525896, -397801367) [ 4.881853] registered taskstats version 1 [ 4.886186] Loading compiled-in X.509 certificates [ 4.886679] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 83196cf451ce12d1de59d40337b38d19869f845c' [ 4.886963] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 4.887237] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 4.887378] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 4.887387] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 4.888936] page_owner is disabled [ 4.889147] pstore: Using crash dump compression: deflate [ 4.889157] Key type big_key registered [ 4.951740] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.951743] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.952148] hub 2-12:1.0: USB hub found [ 4.952266] hub 2-12:1.0: 4 ports detected [ 4.970887] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.970890] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.980754] Key type encrypted registered [ 4.980761] ima: No TPM chip found, activating TPM-bypass! [ 4.980763] Loading compiled-in module X.509 certificates [ 4.981047] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 83196cf451ce12d1de59d40337b38d19869f845c' [ 4.981050] ima: Allocated hash algorithm: sha256 [ 4.981058] ima: No architecture policies found [ 4.981066] evm: Initialising EVM extended attributes: [ 4.981066] evm: security.selinux [ 4.981067] evm: security.SMACK64 (disabled) [ 4.981067] evm: security.SMACK64EXEC (disabled) [ 4.981068] evm: security.SMACK64TRANSMUTE (disabled) [ 4.981068] evm: security.SMACK64MMAP (disabled) [ 4.981068] evm: security.apparmor (disabled) [ 4.981069] evm: security.ima [ 4.981069] evm: security.capability [ 4.981070] evm: HMAC attrs: 0x1 [ 4.994231] hub 1-1:1.0: USB hub found [ 4.998183] hub 1-1:1.0: 8 ports detected [ 5.009068] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.009071] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.020521] hub 3-1:1.0: USB hub found [ 5.025175] hub 3-1:1.0: 6 ports detected [ 5.221857] clk: Disabling unused clocks [ 5.226701] Freeing unused decrypted memory: 2028K [ 5.232011] Freeing unused kernel image (initmem) memory: 3944K [ 5.241573] ud USB device num[ 5.251549] Wprotecting the kernel read-only data: 28672k [ 5.257493] Freeing unused kernel image (rodata/data gap) memory: 192K [ 5.302091] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.302092] x86/mm: Checking user space page tables [ 5.338297] x86/mm: Checked W+X mappings: pas 5.338301] Run /init as init process [ 5.345952] usb 2-12.1: New USB devicidVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.345955] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.350859] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 5.375925] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.376035] systemd[1]: Detected architecture x86-64. [ 5.376037] systemd[1]: Running in initrd. [ 5.401634] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 5.404359] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 5.404416] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.461664] systemd[1]: Hostname set to . [ 5.518818] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.518926] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.540581] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.554584] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.566640] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.577645] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.589640] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.604654] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.618660] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.630854] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.644630] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.657578] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.676439] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.692607] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.705244] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.718175] systemd[1]: Starting Create System Users... Starting Creat[ 5.725055] fuse: init (API version 7.36) e System Users... [ 5.734174] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.747251] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 6.126010] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started [0;[ 6.165688] igb: Intel(R) Gigabit Ethernet Network Driver 1;39mShow Plymou[ 6.165694] igb: Copyright (c) 2007-2014 Intel Corporation. th Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Di[ 6.186942] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver rectory Watch[0[ 6.186949] ixgbe: Copyright (c) 1999-2016 Intel Corporation. m. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.224186] ACPI: bus type drm_connector registered [ 6.224289] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.224294] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.232821] scsi host0: ahci [ 6.232945] scsi host1: ahci [ 6.233048] scsi host2: ahci [ 6.233146] scsi host3: ahci [ 6.233187] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 lpm-pol 0 [ 6.233190] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 lpm-pol 0 [ 6.233192] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 lpm-pol 0 [ 6.233195] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 lpm-pol 0 [ 6.233414] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.233417] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.238173] igb 0000:07:00.0: added PHC on eth0 [ 6.238201] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.238203] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:39:a2 [ 6.238279] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.238280] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.247849] scsi host4: ahci [ 6.247940] scsi host5: ahci [ 6.248046] scsi host6: ahci [ 6.248152] scsi host7: ahci [ 6.248240] scsi host8: ahci [ 6.248331] scsi host9: ahci [ 6.248371] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 lpm-pol 0 [ 6.248373] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 lpm-pol 0 [ 6.248376] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 lpm-pol 0 [ 6.248378] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 lpm-pol 0 [ 6.248381] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 lpm-pol 0 [ 6.248384] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 lpm-pol 0 [ 6.281209] nvme nvme0: pci function 0000:02:00.0 [ 6.283107] nvme nvme0: 8/0/0 default/read/poll queues [ 6.296069] igb 0000:07:00.1: added PHC on eth1 [ 6.296115] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.296117] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:39:a3 [ 6.296209] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.296210] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.317679] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.372327] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.454502] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.463535] Console: switching to colour dummy device 80x25 [ 6.463719] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.463721] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.463738] ast 0000:06:00.0: [drm] Using analog VGA [ 6.463747] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.469301] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.475199] fbcon: astdrmfb (fb0) is primary device [ 6.505354] Console: switching to colour frame buffer device 128x48 [ 6.523488] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.539001] ata2: SATA link down (SStatus 0 SControl 300) [ 6.539260] ata4: SATA link down (SStatus 0 SControl 300) [ 6.539496] ata1: SATA link down (SStatus 0 SControl 300) [ 6.539740] ata3: SATA link down (SStatus 0 SControl 300) [ 6.555100] ata8: SATA link down (SStatus 0 SControl 300) [ 6.555406] ata7: SATA link down (SStatus 0 SControl 300) [ 6.555684] ata9: SATA link down (SStatus 0 SControl 300) [ 6.555966] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.556287] ata10: SATA link down (SStatus 0 SControl 300) [ 6.556644] ata6: SATA link down (SStatus 0 SControl 300) [ 6.557084] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.557571] ata5.00: NCQ Send/Recv Log not supported [ 6.557572] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.558996] ata5.00: NCQ Send/Recv Log not supported [ 6.558998] ata5.00: configured for UDMA/133 [ 6.559095] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.630760] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.641614] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.641648] sd 4:0:0:0: [sda] Write Protect is off [ 6.641677] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.641705] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.649328] sda: sda1 [ 6.649370] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.322813] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.323104] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.323187] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.323188] ixgbe 0000:03:00.0: 0c:c4:7a:88:6f:6c [ 7.325568] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.482753] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.483052] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.483134] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.483135] ixgbe 0000:03:00.1: 0c:c4:7a:88:6f:6d [ 7.486136] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.493594] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.527415] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.730378] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 8.067590] memfd_create() without MFD_EXEC nor MFD_NOEXEC_SEAL, pid=1 'systemd' Starting Switch Root... [ 8.080366] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). [ 8.646626] SELinux: policy capability network_peer_controls=1 [ 8.646634] SELinux: policy capability open_perms=1 [ 8.646635] SELinux: policy capability extended_socket_class=1 [ 8.646637] SELinux: policy capability always_check_network=0 [ 8.646638] SELinux: policy capability cgroup_seclabel=1 [ 8.646639] SELinux: policy capability nnp_nosuid_transition=1 [ 8.646640] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.696320] audit: type=1403 audit(1718121752.740:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.698807] systemd[1]: Successfully loaded SELinux policy in 103.152ms. [ 8.778921] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.351ms. [ 8.786754] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.786902] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.764107] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.764233] systemd[1]: Stopped Switch Root. [ 9.771554] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.771857] systemd[1]: Created slice Slice /system/getty. [ 9.775839] systemd[1]: Created slice Slice /system/modprobe. [ 9.784704] systemd[1]: Created slice Slice /system/serial-getty. [ 9.790181] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.795898] systemd[1]: Created slice User and Session Slice. [ 9.802569] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.802716] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.808165] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.813503] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.828405] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.835948] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.845324] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.855656] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.866043] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.876320] systemd[1]: Reached target Local Encrypted Volumes. [ 9.886656] systemd[1]: Stopped target Switch Root. [ 9.897321] systemd[1]: Stopped target Initrd File Systems. [ 9.908255] systemd[1]: Stopped target Initrd Root File System. [ 9.914167] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.919055] systemd[1]: Reached target Path Units. [ 9.924613] systemd[1]: Reached target Slice Units. [ 9.930521] systemd[1]: Reached target Swaps. [ 9.937294] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.942430] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.951408] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Stopped Switch Root. [ OK ] Crea[ 9.975664] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 9.983603] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [[ 9.991475] systemd[1]: Listening on Process Core Dump Socket. [ 9.991624] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.999220] systemd[1]: Listening on udev Control Socket. [ 10.005553] systemd[1]: Listening on udev Kernel Socket. [ 10.011534] systemd[1]: Mounting Huge Pages File System... [ 10.016871] systemd[1]: Mounting POSIX Message Queue File System... [ 10.022288] systemd[1]: Mounting Kernel Debug File System... [ 10.028524] systemd[1]: Mounting Kernel Trace File System... [ 10.033477] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [0;32m OK ] Created slice Slice /system/modprobe[ 10.057366] systemd[1]: Starting Create List of Static Device Nodes... [ 10.058199] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 10.065199] systemd[1]: Starting Load Kernel Module configfs... [ 10.075356] systemd[1]: Starting Load Kernel Module drm... [ 10.081313] systemd[1]: Starting Load Kernel Module fuse... [ 10.088371] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.091610] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.091652] systemd[1]: Stopped Plymouth switch root service. [ 10.100057] systemd[1]: Stopped Journal Service. [0m. [ [ 10.118125] systemd[1]: Starting Journal Service... OK ] Created slice Slice /system/[ 10.127101] systemd[1]: Starting Load Kernel Modules... serial-getty[ 10.134105] systemd[1]: Starting Generate network units from Kernel command line... [ 10.134152] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). . [ OK[ 10.134965] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.142281] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.143166] systemd[1]: Starting Coldplug All udev Devices... [ 10.161880] systemd[1]: Mounted Huge Pages File System. [ 10.168965] systemd[1]: Mounted POSIX Message Queue File System. ] Created [ 10.178322] systemd[1]: Mounted Kernel Debug File System. [ 10.179477] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.184732] systemd[1]: Mounted Kernel Trace File System. [ 10.189549] systemd[1]: Finished Create List of Static Device Nodes. [ 10.195698] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.202342] systemd[1]: Finished Generate network units from Kernel command line. [ 10.211283] systemd[1]: Finished Remount Root and Kernel File Systems. [ 10.216620] systemd[1]: Reached target Preparation for Network. [ 10.222675] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes). [ 10.224542] systemd[1]: Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc). [ 10.262705] systemd[1]: Starting Load/Save OS Random Seed... [ 10.272534] systemd[1]: Create System Users was skipped because no trigger condition checks were met. slice S[ 10.273477] systemd[1]: Starting Create Static Device Nodes in /dev... [ 10.279250] systemd[1]: Started Journal Service. lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached t[ 10.359421] systemd-journald[578]: Received client request to flush runtime journal. arget ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibil[ 10.474856] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.474878] device-mapper: uevent: version 1.0.3 [ 10.474964] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ity Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.958878] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.960815] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.962667] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.962670] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.984713] igb 0000:07:00.0: DCA enabled [ 10.984731] igb 0000:07:00.1: DCA enabled [ 10.996206] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.012533] IPMI message handler: version 39.2 [ 11.033605] ipmi device interface [ 11.037729] power_meter ACPI000D:00: Found ACPI power meter. [ 11.038044] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.038115] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 11.065468] ipmi_si: IPMI System Interface driver [ 11.067016] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.067021] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.067024] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.069697] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.069812] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ OK [[ 11.072685] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI 0m] Started [0;[ 11.072691] ipmi_si: Adding ACPI-specified kcs state machine [ 11.102267] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 1;39m/usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and D[ 11.140803] input: PC Speaker as /devices/platform/pcspkr/input/input4 irectories. Starting Security Auditing Service... Starting RPC Bind... [ 11.178318] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.178326] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.178329] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.189522] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. Mountin[ 11.209829] iTCO_vendor_support: vendor-support=0 g RPC Pipe File System... [[0;32[ 11.218502] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) m OK ] Fou[ 11.218738] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.223772] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) nd device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.281144] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.337933] ipmi_ssif: IPMI SSIF Interface driver [ 11.344016] RPC: Registered named UNIX socket transport module. [ 11.344023] RPC: Registered udp transport module. [ 11.344028] RPC: Registered tcp transport module. [ 11.344029] RPC: Registered tcp-with-tls transport module. [ 11.344030] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK [ 11.639987] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [0m] Reached target Sys[ 11.649718] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.649835] XFS (dm-4): Mounting V4 Filesystem 39b4a009-9ed6-45ff-8ce0-8277889f8746 tem Initializati[ 11.657756] XFS (dm-4): Ending clean mount [ 11.657804] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) on. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates m[ 11.691775] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.691778] EDAC sbridge: Ver: 1.1.2 locate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached ta[ 11.735501] intel_rapl_common: Found RAPL domain package [ 11.735520] intel_rapl_common: Found RAPL domain dram rget Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.438968] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.582470] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.809562] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 13.997635] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.997767] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.171 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... + '[' 172.21.15.171 '!=' '' ']' + set -e + '[' -n 172.21.15.171 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.171 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.171 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 20.772704] block sda: the capability attribute has been deprecated. + newhostname=smithi171.front.sepia.ceph.com + '[' -n smithi171.front.sepia.ceph.com ']' + hostname smithi171.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi171 + echo smithi171 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.171 smithi171.front.sepia.ceph.com smithi171/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-452.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-06-11T16:02:51.407 DEBUG:teuthology.orchestra.console.smithi171:expect after: smithi171 login: 2024-06-11T16:02:51.460 DEBUG:teuthology.orchestra.console.smithi171:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Cthe Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6F 6D GUID: 00000000 0000 0000 0000 0CC47AD939A2 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.171 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.171 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6f:6d)... Configuring (net0 0c:c4:7a:88:6f:6d).... Configuring (net0 0c:c4:7a:88:6f:6d)..... Configuring (net0 0c:c4:7a:88:6f:6d)...... ok .    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-452.el9.x86_64) 9  CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9              The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-452.el9.x86_64) 9   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9          The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h        [ 0.000000] Linux version 5.14.0-452.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Sat May 18 20:39:48 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical 0.000000] BI0000000000000-0xusable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.717 MHz processor [ 0.000398] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000402] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000404] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000733] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006376] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006384] Using GB pages for direct mapping [ 0.006485] RAMDISK: [mem 0x342bc000-0x36155fff] [ 0.006487] ACPI: Early table checksum verification disabled [ 0.006489] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006492] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006497] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006501] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006504] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006506] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006508] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006510] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006512] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006514] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006517] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006519] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006521] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006523] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006526] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006528] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006530] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006532] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006535] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006537] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006539] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006541] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006544] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006545] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006546] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006547] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006548] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006548] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006549] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006550] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006550] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006551] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006551] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006552] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006553] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006553] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006554] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006554] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006555] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006555] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006556] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006557] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006557] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006558] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006604] No NUMA configuration found [ 0.006604] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006613] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006787] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006823] Zone ranges: [ 0.006823] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006825] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006826] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006827] Device empty [ 0.006828] Movable zone start for each node [ 0.006830] Early memory node ranges [ 0.006830] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006831] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006832] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006836] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006840] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006878] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011880] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011991] ACPI: PM-Timer IO Port: 0x408 [ 0.011999] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012001] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012002] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012003] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012003] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012004] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012013] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012018] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012019] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012021] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012025] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012026] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012030] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012031] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012039] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012041] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012042] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012043] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012044] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012045] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012046] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012047] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012048] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012049] Booting paravirtualized kernel on bare hardware [ 0.012051] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016398] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016619] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016641] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016694] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-452.el9.x86_64", will be passed to user space. [ 0.016711] random: crng init done [ 0.018896] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020042] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020148] Fallback order for Node 0: 0 [ 0.020151] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.020152] Policy zone: Normal [ 0.020295] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020303] software IO TLB: area num 8. [ 0.048571] Memory: 1751980K/33438012K available (16384K kernel code, 5646K rwdata, 12096K rodata, 3944K init, 5820K bss, 987376K reserved, 0K cma-reserved) [ 0.048678] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048686] Kernel/User page tables isolation: enabled [ 0.048710] ftrace: allocating 47491 entries in 186 pages [ 0.066981] ftrace: allocated 186 pages with 5 groups [ 0.067502] Dynamic Preempt: voluntary [ 0.067530] rcu: Preemptible hierarchical RCU implementation. [ 0.067531] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067532] Trampoline variant of Tasks RCU enabled. [ 0.067533] Rude variant of Tasks RCU enabled. [ 0.067533] Tracing variant of Tasks RCU enabled. [ 0.067534] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067534] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070905] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.071067] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.071177] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076420] Console: colour VGA+ 80x25 [ 0.076437] printk: console [ttyS1] enabled [ 1.117772] ACPI: Core revision 20230331 [ 1.121865] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130995] APIC: Switch to symmetric I/O mode setup [ 1.135965] DMAR: Host address width 46 [ 1.139807] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.145125] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.153121] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.159385] DMAR: ATSR flags: 0x0 [ 1.162706] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168974] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.175326] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181680] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.187078] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.187078] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.202112] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.207414] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.213638] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.224001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327245ad07c, max_idle_ns: 440795310094 ns [ 1.234513] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.43 BogoMIPS (lpj=3499717) [ 1.235530] CPU0: Thermal monitoring enabled (TM1) [ 1.236566] process: using mwait in idle threads [ 1.237513] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.238511] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.239513] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.240512] Spectre V2 : Mitigation: Retpolines [ 1.241511] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.242511] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.243512] Speculative Store Bypass: Vulnerable [ 1.244517] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245511] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246511] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.247515] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.248511] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.249511] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.250512] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.251511] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.264122] Freeing SMP alternatives memory: 36K [ 1.264512] pid_max: default: 32768 minimum: 301 [ 1.265529] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.266516] Yama: becoming mindful. [ 1.267516] SELinux: Initializing. [ 1.268528] LSM support for eBPF active [ 1.269569] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270550] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374538] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.376597] cblist_init_generic: Setting adjustable number of callback queues. [ 1.377511] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378523] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379521] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.380520] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.381512] ... version: 3 [ 1.382511] ... bit width: 48 [ 1.383511] ... generic registers: 4 [ 1.384511] ... value mask: 0000ffffffffffff [ 1.385511] ... max period: 00007fffffffffff [ 1.386511] ... fixed-purpose events: 3 [ 1.387512] ... event mask: 000000070000000f [ 1.388595] signal: max sigframe size: 1776 [ 1.389522] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.390536] rcu: Hierarchical SRCU implementation. [ 1.390537] rcu: Max phase no-delay instances is 400. [ 1.393535] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.395564] smp: Bringing up secondary CPUs ... [ 1.396578] smpboot: x86: Booting SMP configuration: [ 1.396580] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400073] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400073] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400073] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.403551] smp: Brought up 1 node, 8 CPUs [ 1.403551] smpboot: Max logical packages: 1 [ 1.403551] smpboot: Total of 8 processors activated (55995.47 BogoMIPS) [ 1.444763] node 0 deferred pages initialised in 40ms [ 1.451419] devtmpfs: initialized [ 1.451536] x86/mm: Memory block size: 128MB [ 1.453959] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453959] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453959] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453959] pinctrl core: initialized pinctrl subsystem [ 1.477328] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.477436] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.477442] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.477445] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.477454] audit: initializing netlink subsys (disabled) [ 1.477513] audit: type=2000 audit(1718121744.263:1): state=initialized audit_enabled=0 res=1 [ 1.477572] thermal_sys: Registered thermal governor 'fair_share' [ 1.477573] thermal_sys: Registered thermal governor 'step_wise' [ 1.477574] thermal_sys: Registered thermal governor 'user_space' [ 1.483514] cpuidle: using governor menu [ 1.489542] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.489542] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.489596] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.489600] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.489611] PCI: Using configuration type 1 for base access [ 1.509549] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.509555] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.509555] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.509555] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.509555] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.518323] cryptd: max_cpu_qlen set to 1000 [ 1.518582] ACPI: Added _OSI(Module Device) [ 1.518583] ACPI: Added _OSI(Processor Device) [ 1.518584] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.518584] ACPI: Added _OSI(Processor Aggregator Device) [ 1.518585] ACPI: Added _OSI(Linux-Dell-Video) [ 1.518586] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.518586] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.541701] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.543855] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.546606] ACPI: Dynamic OEM Table Load: [ 1.560184] ACPI: _OSC evaluated successfully for all CPUs [ 1.560439] ACPI: Interpreter enabled [ 1.560449] ACPI: PM: (supports S0 S4 S5) [ 1.560450] ACPI: Using IOAPIC for interrupt routing [ 1.561902] HEST: Enabling Firmware First mode for corrected errors. [ 1.612652] HEST: Table parsing has been initialized. [ 1.612772] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.612774] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.612775] PCI: Using E820 reservations for host bridge windows [ 1.613204] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.633815] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.633820] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.634910] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.635438] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.635439] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.635465] PCI host bridge to bus 0000:ff [ 1.635466] pci_bus 0000:ff: root bus resource [bus ff] [ 1.635476] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.635522] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.635554] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.635584] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.635614] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.635643] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.635672] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.635700] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.635731] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.635759] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.635788] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.635819] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.635848] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.635879] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.635908] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.635938] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.635966] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.635994] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.636023] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.636044] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.636079] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636139] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636199] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636258] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636316] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636374] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636432] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.636478] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.636514] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636555] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636596] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636637] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636677] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.636707] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.636738] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.636768] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.636799] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636840] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636883] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636925] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.636967] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.637002] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.637032] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.637065] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.637099] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.637129] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.637160] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.637190] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.637224] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.637254] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.637283] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.637313] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.637333] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.637365] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.637395] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.639597] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.639600] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.639731] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.639971] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.639972] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.640369] PCI host bridge to bus 0000:00 [ 1.640371] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.640372] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.640373] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.640374] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.640375] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.640376] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.640377] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.640397] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.640498] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.640510] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.640547] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.640638] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.640650] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.640653] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.640685] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.640773] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.640784] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.640786] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.640788] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.640792] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.640821] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.640905] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640912] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.640987] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640994] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.641067] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641074] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.641147] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641155] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.641226] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641234] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.641305] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641313] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.641384] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641392] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.641467] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641474] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.641550] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641610] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641690] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641746] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.641751] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.641830] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.642066] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.642086] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.642097] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.642108] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.642119] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.642129] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.642141] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.642199] pci 0000:00:11.4: PME# supported from D3hot [ 1.642277] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.642302] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.642389] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.642475] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.642499] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.642587] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.642655] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.642679] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.642767] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.642850] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.642871] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.642986] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.643066] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.643103] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.643195] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.643292] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.643329] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.643334] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.643337] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.643428] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.643527] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.643564] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.643569] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.643572] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.643660] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.643763] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.643785] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.643901] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.643981] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.644183] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.644201] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.644212] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.644223] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.644233] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.644244] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.644254] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.644308] pci 0000:00:1f.2: PME# supported from D3hot [ 1.644369] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.644393] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.644422] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.644586] acpiphp: Slot [1] registered [ 1.644597] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.644700] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.644709] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.644726] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.644729] pci 0000:02:00.0: enabling Extended Tags [ 1.644830] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.644937] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.644948] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.644953] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.644963] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.644967] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.645003] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.645019] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645021] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.645029] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645030] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.645181] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.645191] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.645196] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.645206] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.645210] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.645246] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.645259] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645261] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.645269] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.645270] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.645409] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.645454] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.645548] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.645620] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.645633] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.645638] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.645691] pci 0000:05:00.0: enabling Extended Tags [ 1.645824] pci 0000:05:00.0: supports D1 D2 [ 1.645824] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.646000] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.646088] pci_bus 0000:06: extended config space not accessible [ 1.646121] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.646158] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.646177] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.646197] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.646297] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.646367] pci 0000:06:00.0: supports D1 D2 [ 1.646368] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.646516] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.646658] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.646692] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.646728] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.646746] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.646969] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.647030] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647031] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.647067] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647068] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.647394] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.647427] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.647464] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.647482] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.647703] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.647764] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647765] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.647799] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.647800] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.648097] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.648110] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.648768] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.648799] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.648830] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.648863] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.648894] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.648894] ACPI: PCI: Interrupt link LNKE disabled [ 1.648924] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.648925] ACPI: PCI: Interrupt link LNKF disabled [ 1.648955] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.648955] ACPI: PCI: Interrupt link LNKG disabled [ 1.648985] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.648985] ACPI: PCI: Interrupt link LNKH disabled [ 1.649515] iommu: Default domain type: Translated [ 1.649516] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.649592] SCSI subsystem initialized [ 1.649607] ACPI: bus type USB registered [ 1.649619] usbcore: registered new interface driver usbfs [ 1.649625] usbcore: registered new interface driver hub [ 1.649630] usbcore: registered new device driver usb [ 1.649649] pps_core: LinuxPPS API ver. 1 registered [ 1.649649] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.649652] PTP clock support registered [ 1.649666] EDAC MC: Ver: 3.0.0 [ 1.649666] NetLabel: Initializing [ 1.649666] NetLabel: domain hash size = 128 [ 1.649666] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.649666] NetLabel: unlabeled traffic allowed by default [ 1.649666] PCI: Using ACPI for IRQ routing [ 1.660532] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.660534] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.660535] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.660536] vgaarb: loaded [ 1.660540] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.660544] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.529641] clocksource: Switched to clocksource tsc-early [ 3.537363] VFS: Disk quotas dquot_6.6.0 [ 3.537375] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.537424] pnp: PnP ACPI init [ 3.537749] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.537752] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.537753] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.537754] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.537755] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.537756] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.537757] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.537759] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.537760] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.537761] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.537762] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.537763] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.537763] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.537924] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.537925] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.537926] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.537927] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.537928] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.538589] pnp: PnP ACPI: found 5 devices [ 3.544038] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.544074] NET: Registered PF_INET protocol family [ 3.544237] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.546484] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.546519] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.546531] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.546766] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.546885] TCP: Hash tables configured (established 262144 bind 65536) [ 3.547003] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.547086] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.547143] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.547224] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.547229] NET: Registered PF_XDP protocol family [ 3.547250] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.547260] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 3.547262] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.547267] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.547269] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.547275] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547276] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547278] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547279] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547280] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547281] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547282] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547283] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547284] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547285] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547286] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547287] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547289] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547289] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547291] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 3.547291] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 3.547293] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.547294] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.547296] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.547297] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.547300] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.547313] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.547315] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.547323] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.547339] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.547341] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.547347] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.547356] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 3.547362] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 3.547368] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 3.547375] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 3.547382] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.547384] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.547389] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.547392] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.547398] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 3.547399] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.547400] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.547401] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.547402] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.547403] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.547404] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.547405] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.547406] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.547407] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.547407] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.547409] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.547409] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.547410] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.547411] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.547412] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.547413] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.547413] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.547572] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.564555] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16417 usecs [ 3.576553] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11701 usecs [ 3.576567] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.576603] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.576604] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.576610] ACPI: bus type thunderbolt registered [ 3.576613] Trying to unpack rootfs image as initramfs... [ 3.892239] Freeing initrd memory: 31336K [ 4.237384] Initialise system trusted keyrings [ 4.237395] Key type blacklist registered [ 4.237438] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.237455] zbud: loaded [ 4.254889] integrity: Platform Keyring initialized [ 4.254893] integrity: Machine keyring initialized [ 4.262805] NET: Registered PF_ALG protocol family [ 4.262807] xor: automatically using best checksumming function avx [ 4.262808] Key type asymmetric registered [ 4.262809] Asymmetric key parser 'x509' registered [ 4.262809] Running certificate verification selftests [ 4.264497] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 4.264975] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 4.265004] io scheduler mq-deadline registered [ 4.265005] io scheduler kyber registered [ 4.265009] io scheduler bfq registered [ 4.320644] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 4.320953] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.321107] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.321249] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.321379] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.321538] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.321683] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.321836] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.321913] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 4.374150] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.374171] ACPI: button: Power Button [PWRB] [ 4.374193] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.374246] ACPI: button: Power Button [PWRF] [ 4.399119] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.399123] pstore: Registered erst as persistent store backend [ 4.399227] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.399327] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.406633] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.412903] Non-volatile memory driver v1.3 [ 4.437752] rdac: device handler registered [ 4.437776] hp_sw: device handler registered [ 4.437777] emc: device handler registered [ 4.437794] alua: device handler registered [ 4.438066] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.438102] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 4.438116] ehci-pci 0000:00:1d.0: debug port 2 [ 4.442029] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.448544] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.448575] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.448577] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.448578] usb usb1: Product: EHCI Host Controller [ 4.448579] usb usb1: Manufacturer: Linux 5.14.0-452.el9.x86_64 ehci_hcd [ 4.448580] usb usb1: SerialNumber: 0000:00:1d.0 [ 4.448671] hub 1-0:1.0: USB hub found [ 4.448675] hub 1-0:1.0: 2 ports detected [ 4.448799] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.448834] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 4.449920] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.450110] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.450133] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.450168] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.450169] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 4.450170] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.450188] ehci-pci 0000:00:1a.0: debug port 2 [ 4.450211] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.450213] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.450214] usb usb2: Product: xHCI Host Controller [ 4.450215] usb usb2: Manufacturer: Linux 5.14.0-452.el9.x86_64 xhci-hcd [ 4.450217] usb usb2: SerialNumber: 0000:00:14.0 [ 4.450323] hub 2-0:1.0: USB hub found [ 4.450355] hub 2-0:1.0: 15 ports detected [ 4.452933] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 4.452935] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.452937] usb usb4: Product: xHCI Host Controller [ 4.452938] usb usb4: Manufacturer: Linux 5.14.0-452.el9.x86_64 xhci-hcd [ 4.452939] usb usb4: SerialNumber: 0000:00:14.0 [ 4.453018] hub 4-0:1.0: USB hub found [ 4.453036] hub 4-0:1.0: 6 ports detected [ 4.454115] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.454194] usbcore: registered new interface driver usbserial_generic [ 4.454199] usbserial: USB Serial support registered for generic [ 4.454233] i8042: PNP: No PS/2 controller found. [ 4.454281] mousedev: PS/2 mouse device common for all mice [ 4.454336] rtc_cmos 00:00: RTC can wake from S4 [ 4.454615] rtc_cmos 00:00: registered as rtc0 [ 4.454662] rtc_cmos 00:00: setting system clock to 2024-06-11T16:02:28 UTC (1718121748) [ 4.454683] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.460546] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.460573] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 4.460574] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.460575] usb usb3: Product: EHCI Host Controller [ 4.460576] usb usb3: Manufacturer: Linux 5.14.0-452.el9.x86_64 ehci_hcd [ 4.460577] usb usb3: SerialNumber: 0000:00:1a.0 [ 4.460653] hub 3-0:1.0: USB hub found [ 4.460656] hub 3-0:1.0: 2 ports detected [ 4.637538] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.637543] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.772467] clocksource: Switched to clocksource tsc [ 4.772469] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.772547] intel_pstate: Intel P-state driver initializing [ 4.790382] hid: raw HID events driver (C) Jiri Kosina [ 4.790417] usbcore: registered new interface driver usbhid [ 4.790417] usbhid: USB HID core driver [ 4.790444] drop_monitor: Initializing network drop monitor service [ 4.799418] Initializing XFRM netlink socket [ 4.799436] NET: Registered PF_INET6 protocol family [ 4.804231] Segment Routing with IPv6 [ 4.804248] NET: Registered PF_PACKET protocol family [ 4.804272] mpls_gso: MPLS GSO support [ 4.823561] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 4.824552] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 4.846408] microcode: Current revision: 0x0b00001b [ 4.851452] resctrl: L3 allocation detected [ 4.851455] resctrl: L3 monitoring detected [ 4.851471] IPI shorthand broadcast: enabled [ 4.851476] AVX2 version of gcm_enc/dec engaged. [ 4.868769] AES CTR mode by8 optimization enabled [ 4.868812] sched_clock: Marking stable (3725308645, 1143415884)->(5266525896, -397801367) [ 4.881853] registered taskstats version 1 [ 4.886186] Loading compiled-in X.509 certificates [ 4.886679] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 83196cf451ce12d1de59d40337b38d19869f845c' [ 4.886963] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 4.887237] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 4.887378] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 4.887387] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 4.888936] page_owner is disabled [ 4.889147] pstore: Using crash dump compression: deflate [ 4.889157] Key type big_key registered [ 4.951740] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.951743] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.952148] hub 2-12:1.0: USB hub found [ 4.952266] hub 2-12:1.0: 4 ports detected [ 4.970887] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.970890] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.980754] Key type encrypted registered [ 4.980761] ima: No TPM chip found, activating TPM-bypass! [ 4.980763] Loading compiled-in module X.509 certificates [ 4.981047] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: 83196cf451ce12d1de59d40337b38d19869f845c' [ 4.981050] ima: Allocated hash algorithm: sha256 [ 4.981058] ima: No architecture policies found [ 4.981066] evm: Initialising EVM extended attributes: [ 4.981066] evm: security.selinux [ 4.981067] evm: security.SMACK64 (disabled) [ 4.981067] evm: security.SMACK64EXEC (disabled) [ 4.981068] evm: security.SMACK64TRANSMUTE (disabled) [ 4.981068] evm: security.SMACK64MMAP (disabled) [ 4.981068] evm: security.apparmor (disabled) [ 4.981069] evm: security.ima [ 4.981069] evm: security.capability [ 4.981070] evm: HMAC attrs: 0x1 [ 4.994231] hub 1-1:1.0: USB hub found [ 4.998183] hub 1-1:1.0: 8 ports detected [ 5.009068] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.009071] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.020521] hub 3-1:1.0: USB hub found [ 5.025175] hub 3-1:1.0: 6 ports detected [ 5.221857] clk: Disabling unused clocks [ 5.226701] Freeing unused decrypted memory: 2028K [ 5.232011] Freeing unused kernel image (initmem) memory: 3944K [ 5.241573] ud USB device num[ 5.251549] Wprotecting the kernel read-only data: 28672k [ 5.257493] Freeing unused kernel image (rodata/data gap) memory: 192K [ 5.302091] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.302092] x86/mm: Checking user space page tables [ 5.338297] x86/mm: Checked W+X mappings: pas 5.338301] Run /init as init process [ 5.345952] usb 2-12.1: New USB devicidVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.345955] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.350859] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 5.375925] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.376035] systemd[1]: Detected architecture x86-64. [ 5.376037] systemd[1]: Running in initrd. [ 5.401634] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 5.404359] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 5.404416] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 Welcome to CentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.461664] systemd[1]: Hostname set to . [ 5.518818] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.518926] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ 5.540581] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 5.554584] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 5.566640] systemd[1]: Reached target Swaps. [ OK ] Reached target Swaps. [ 5.577645] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ 5.589640] systemd[1]: Listening on D-Bus System Message Bus Socket. [ OK ] Listening on D-Bus System Message Bus Socket. [ 5.604654] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 5.618660] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 5.630854] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 5.644630] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 5.657578] systemd[1]: Reached target Socket Units. [ OK ] Reached target Socket Units. [ 5.676439] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.692607] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.705244] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.718175] systemd[1]: Starting Create System Users... Starting Creat[ 5.725055] fuse: init (API version 7.36) e System Users... [ 5.734174] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.747251] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 6.126010] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started [0;[ 6.165688] igb: Intel(R) Gigabit Ethernet Network Driver 1;39mShow Plymou[ 6.165694] igb: Copyright (c) 2007-2014 Intel Corporation. th Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Di[ 6.186942] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver rectory Watch[0[ 6.186949] ixgbe: Copyright (c) 1999-2016 Intel Corporation. m. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.224186] ACPI: bus type drm_connector registered [ 6.224289] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.224294] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.232821] scsi host0: ahci [ 6.232945] scsi host1: ahci [ 6.233048] scsi host2: ahci [ 6.233146] scsi host3: ahci [ 6.233187] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 lpm-pol 0 [ 6.233190] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 lpm-pol 0 [ 6.233192] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 lpm-pol 0 [ 6.233195] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 lpm-pol 0 [ 6.233414] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.233417] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.238173] igb 0000:07:00.0: added PHC on eth0 [ 6.238201] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.238203] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:39:a2 [ 6.238279] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.238280] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.247849] scsi host4: ahci [ 6.247940] scsi host5: ahci [ 6.248046] scsi host6: ahci [ 6.248152] scsi host7: ahci [ 6.248240] scsi host8: ahci [ 6.248331] scsi host9: ahci [ 6.248371] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 44 lpm-pol 0 [ 6.248373] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 44 lpm-pol 0 [ 6.248376] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 44 lpm-pol 0 [ 6.248378] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 44 lpm-pol 0 [ 6.248381] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 44 lpm-pol 0 [ 6.248384] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 44 lpm-pol 0 [ 6.281209] nvme nvme0: pci function 0000:02:00.0 [ 6.283107] nvme nvme0: 8/0/0 default/read/poll queues [ 6.296069] igb 0000:07:00.1: added PHC on eth1 [ 6.296115] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.296117] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:39:a3 [ 6.296209] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.296210] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.317679] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.372327] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.454502] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.463535] Console: switching to colour dummy device 80x25 [ 6.463719] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.463721] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.463738] ast 0000:06:00.0: [drm] Using analog VGA [ 6.463747] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.469301] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.475199] fbcon: astdrmfb (fb0) is primary device [ 6.505354] Console: switching to colour frame buffer device 128x48 [ 6.523488] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.539001] ata2: SATA link down (SStatus 0 SControl 300) [ 6.539260] ata4: SATA link down (SStatus 0 SControl 300) [ 6.539496] ata1: SATA link down (SStatus 0 SControl 300) [ 6.539740] ata3: SATA link down (SStatus 0 SControl 300) [ 6.555100] ata8: SATA link down (SStatus 0 SControl 300) [ 6.555406] ata7: SATA link down (SStatus 0 SControl 300) [ 6.555684] ata9: SATA link down (SStatus 0 SControl 300) [ 6.555966] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.556287] ata10: SATA link down (SStatus 0 SControl 300) [ 6.556644] ata6: SATA link down (SStatus 0 SControl 300) [ 6.557084] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.557571] ata5.00: NCQ Send/Recv Log not supported [ 6.557572] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.558996] ata5.00: NCQ Send/Recv Log not supported [ 6.558998] ata5.00: configured for UDMA/133 [ 6.559095] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.630760] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.641614] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.641648] sd 4:0:0:0: [sda] Write Protect is off [ 6.641677] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.641705] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.649328] sda: sda1 [ 6.649370] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.322813] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.323104] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.323187] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.323188] ixgbe 0000:03:00.0: 0c:c4:7a:88:6f:6c [ 7.325568] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.482753] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.483052] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.483134] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.483135] ixgbe 0000:03:00.1: 0c:c4:7a:88:6f:6d [ 7.486136] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.493594] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.527415] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.730378] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. [ 8.067590] memfd_create() without MFD_EXEC nor MFD_NOEXEC_SEAL, pid=1 'systemd' Starting Switch Root... [ 8.080366] systemd-journald[279]: Received SIGTERM from PID 1 (systemd). [ 8.646626] SELinux: policy capability network_peer_controls=1 [ 8.646634] SELinux: policy capability open_perms=1 [ 8.646635] SELinux: policy capability extended_socket_class=1 [ 8.646637] SELinux: policy capability always_check_network=0 [ 8.646638] SELinux: policy capability cgroup_seclabel=1 [ 8.646639] SELinux: policy capability nnp_nosuid_transition=1 [ 8.646640] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.696320] audit: type=1403 audit(1718121752.740:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.698807] systemd[1]: Successfully loaded SELinux policy in 103.152ms. [ 8.778921] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 27.351ms. [ 8.786754] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.786902] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.764107] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.764233] systemd[1]: Stopped Switch Root. [ 9.771554] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.771857] systemd[1]: Created slice Slice /system/getty. [ 9.775839] systemd[1]: Created slice Slice /system/modprobe. [ 9.784704] systemd[1]: Created slice Slice /system/serial-getty. [ 9.790181] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.795898] systemd[1]: Created slice User and Session Slice. [ 9.802569] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.802716] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.808165] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.813503] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.828405] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.835948] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.845324] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.855656] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.866043] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.876320] systemd[1]: Reached target Local Encrypted Volumes. [ 9.886656] systemd[1]: Stopped target Switch Root. [ 9.897321] systemd[1]: Stopped target Initrd File Systems. [ 9.908255] systemd[1]: Stopped target Initrd Root File System. [ 9.914167] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.919055] systemd[1]: Reached target Path Units. [ 9.924613] systemd[1]: Reached target Slice Units. [ 9.930521] systemd[1]: Reached target Swaps. [ 9.937294] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.942430] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.951408] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Stopped Switch Root. [ OK ] Crea[ 9.975664] systemd[1]: Listening on RPCbind Server Activation Socket. ted slice [0;1;[ 9.983603] systemd[1]: Reached target RPC Port Mapper. 39mSlice /system/getty. [[ 9.991475] systemd[1]: Listening on Process Core Dump Socket. [ 9.991624] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.999220] systemd[1]: Listening on udev Control Socket. [ 10.005553] systemd[1]: Listening on udev Kernel Socket. [ 10.011534] systemd[1]: Mounting Huge Pages File System... [ 10.016871] systemd[1]: Mounting POSIX Message Queue File System... [ 10.022288] systemd[1]: Mounting Kernel Debug File System... [ 10.028524] systemd[1]: Mounting Kernel Trace File System... [ 10.033477] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [0;32m OK ] Created slice Slice /system/modprobe[ 10.057366] systemd[1]: Starting Create List of Static Device Nodes... [ 10.058199] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 10.065199] systemd[1]: Starting Load Kernel Module configfs... [ 10.075356] systemd[1]: Starting Load Kernel Module drm... [ 10.081313] systemd[1]: Starting Load Kernel Module fuse... [ 10.088371] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.091610] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.091652] systemd[1]: Stopped Plymouth switch root service. [ 10.100057] systemd[1]: Stopped Journal Service. [0m. [ [ 10.118125] systemd[1]: Starting Journal Service... OK ] Created slice Slice /system/[ 10.127101] systemd[1]: Starting Load Kernel Modules... serial-getty[ 10.134105] systemd[1]: Starting Generate network units from Kernel command line... [ 10.134152] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). . [ OK[ 10.134965] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.142281] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.143166] systemd[1]: Starting Coldplug All udev Devices... [ 10.161880] systemd[1]: Mounted Huge Pages File System. [ 10.168965] systemd[1]: Mounted POSIX Message Queue File System. ] Created [ 10.178322] systemd[1]: Mounted Kernel Debug File System. [ 10.179477] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. [ 10.184732] systemd[1]: Mounted Kernel Trace File System. [ 10.189549] systemd[1]: Finished Create List of Static Device Nodes. [ 10.195698] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.202342] systemd[1]: Finished Generate network units from Kernel command line. [ 10.211283] systemd[1]: Finished Remount Root and Kernel File Systems. [ 10.216620] systemd[1]: Reached target Preparation for Network. [ 10.222675] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes). [ 10.224542] systemd[1]: Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc). [ 10.262705] systemd[1]: Starting Load/Save OS Random Seed... [ 10.272534] systemd[1]: Create System Users was skipped because no trigger condition checks were met. slice S[ 10.273477] systemd[1]: Starting Create Static Device Nodes in /dev... [ 10.279250] systemd[1]: Started Journal Service. lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ OK ] Reached target ceph target…on@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached t[ 10.359421] systemd-journald[578]: Received client request to flush runtime journal. arget ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibil[ 10.474856] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.474878] device-mapper: uevent: version 1.0.3 [ 10.474964] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ity Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 10.958878] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.960815] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.962667] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.962670] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 10.984713] igb 0000:07:00.0: DCA enabled [ 10.984731] igb 0000:07:00.1: DCA enabled [ 10.996206] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.012533] IPMI message handler: version 39.2 [ 11.033605] ipmi device interface [ 11.037729] power_meter ACPI000D:00: Found ACPI power meter. [ 11.038044] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.038115] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 11.065468] ipmi_si: IPMI System Interface driver [ 11.067016] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.067021] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.067024] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.069697] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.069812] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ OK [[ 11.072685] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI 0m] Started [0;[ 11.072691] ipmi_si: Adding ACPI-specified kcs state machine [ 11.102267] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 1;39m/usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ OK ] Finished Create Volatile Files and D[ 11.140803] input: PC Speaker as /devices/platform/pcspkr/input/input4 irectories. Starting Security Auditing Service... Starting RPC Bind... [ 11.178318] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.178326] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.178329] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.189522] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. Mountin[ 11.209829] iTCO_vendor_support: vendor-support=0 g RPC Pipe File System... [[0;32[ 11.218502] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) m OK ] Fou[ 11.218738] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.223772] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) nd device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.281144] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.337933] ipmi_ssif: IPMI SSIF Interface driver [ 11.344016] RPC: Registered named UNIX socket transport module. [ 11.344023] RPC: Registered udp transport module. [ 11.344028] RPC: Registered tcp transport module. [ 11.344029] RPC: Registered tcp-with-tls transport module. [ 11.344030] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK [ 11.639987] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [0m] Reached target Sys[ 11.649718] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.649835] XFS (dm-4): Mounting V4 Filesystem 39b4a009-9ed6-45ff-8ce0-8277889f8746 tem Initializati[ 11.657756] XFS (dm-4): Ending clean mount [ 11.657804] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) on. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates m[ 11.691775] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.691778] EDAC sbridge: Ver: 1.1.2 locate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached ta[ 11.735501] intel_rapl_common: Found RAPL domain package [ 11.735520] intel_rapl_common: Found RAPL domain dram rget Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.438968] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.582470] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.809562] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 13.997635] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.997767] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.171 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... + '[' 172.21.15.171 '!=' '' ']' + set -e + '[' -n 172.21.15.171 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.171 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.171 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 20.772704] block sda: the capability attribute has been deprecated. + newhostname=smithi171.front.sepia.ceph.com + '[' -n smithi171.front.sepia.ceph.com ']' + hostname smithi171.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi171 + echo smithi171 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.171 smithi171.front.sepia.ceph.com smithi171/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-452.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi171 login: [disconnect] 2024-06-11T16:02:51.562 INFO:teuthology.misc:Re-opening connections... 2024-06-11T16:02:51.562 INFO:teuthology.misc:trying to connect to ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T16:02:51.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T16:02:51.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-11T16:02:52.039 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-06-11T16:02:52.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-06-11T16:02:52.535 DEBUG:teuthology.misc:waited 0.9734282493591309 2024-06-11T16:02:53.536 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T16:02:53.536 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi171.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-06-11T16:02:53.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-06-11T16:02:53.676 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-06-11T16:02:53.737 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-11T16:02:53.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-11T16:02:53.740 INFO:tasks.ceph.osd.2:Started 2024-06-11T16:02:53.740 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T16:02:53.850 INFO:teuthology.orchestra.run.smithi171.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-06-11T16:02:53.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-06-11T16:02:53.854 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-06-11T16:02:55.101 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T16:02:55.101+0000 7fbc7da19640 -1 Falling back to public interface 2024-06-11T16:02:56.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-06-11T16:02:58.694 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T16:02:58.694+0000 7fbc7da19640 -1 osd.2 37 log_to_monitors true 2024-06-11T16:02:58.855 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T16:02:58.958 INFO:teuthology.orchestra.run.smithi171.stderr:no valid command found; 10 closest matches: 2024-06-11T16:02:58.958 INFO:teuthology.orchestra.run.smithi171.stderr:0 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:1 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:2 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:abort 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:assert 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:bluefs debug_inject_read_zeros 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:bluefs files list 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:bluefs stats 2024-06-11T16:02:58.959 INFO:teuthology.orchestra.run.smithi171.stderr:bluestore allocator dump block 2024-06-11T16:02:58.960 INFO:teuthology.orchestra.run.smithi171.stderr:bluestore allocator fragmentation block 2024-06-11T16:02:58.960 INFO:teuthology.orchestra.run.smithi171.stderr:admin_socket: invalid command 2024-06-11T16:02:58.960 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-06-11T16:02:58.961 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-06-11T16:02:59.075 INFO:tasks.ceph.osd.2.smithi171.stderr:2024-06-11T16:02:59.074+0000 7fbc7112c640 -1 osd.2 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-11T16:03:03.962 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-06-11T16:03:04.069 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-06-11T16:03:04.069 INFO:teuthology.orchestra.run.smithi171.stdout: "ops": [], 2024-06-11T16:03:04.070 INFO:teuthology.orchestra.run.smithi171.stdout: "num_ops": 0 2024-06-11T16:03:04.070 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-06-11T16:03:09.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-06-11T16:03:09.204 INFO:teuthology.orchestra.run.smithi089.stdout:mon.a: {} 2024-06-11T16:03:09.205 INFO:teuthology.orchestra.run.smithi089.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T16:03:09.213 INFO:teuthology.orchestra.run.smithi089.stdout:mon.b: {} 2024-06-11T16:03:09.214 INFO:teuthology.orchestra.run.smithi089.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T16:03:09.222 INFO:teuthology.orchestra.run.smithi089.stdout:mon.c: {} 2024-06-11T16:03:09.223 INFO:teuthology.orchestra.run.smithi089.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-06-11T16:03:09.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-06-11T16:03:10.115 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.0 to 1 (10000) 2024-06-11T16:03:10.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-06-11T16:03:11.125 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-06-11T16:03:11.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-06-11T16:03:12.128 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.1 to 1 (10000) 2024-06-11T16:03:12.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-06-11T16:03:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-06-11T16:03:13.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-06-11T16:03:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:reweighted osd.2 to 1 (10000) 2024-06-11T16:03:14.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-06-11T16:03:15.151 INFO:teuthology.orchestra.run.smithi089.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-06-11T16:03:15.167 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-06-11T16:03:15.167 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-06-11T16:03:15.167 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-06-11T16:03:15.168 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-06-11T16:03:15.168 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-11T16:03:15.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T16:03:15.457 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:15.457 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":82,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T16:03:15.148553+0000","last_up_change":"2024-06-11T16:03:00.063621+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":71,"up_thru":81,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6801","nonce":3596598173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6803","nonce":3596598173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6807","nonce":3596598173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6805","nonce":3596598173}]},"public_addr":"172.21.15.171:6801/3596598173","cluster_addr":"172.21.15.171:6803/3596598173","heartbeat_back_addr":"172.21.15.171:6807/3596598173","heartbeat_front_addr":"172.21.15.171:6805/3596598173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":37}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[1]},{"pgid":"4.0","osds":[0]},{"pgid":"4.1","osds":[1]},{"pgid":"4.2","osds":[1]},{"pgid":"4.3","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.a","osds":[0]},{"pgid":"4.b","osds":[0]},{"pgid":"4.c","osds":[0]},{"pgid":"4.d","osds":[1]},{"pgid":"4.e","osds":[0,1]},{"pgid":"4.11","osds":[0]},{"pgid":"4.13","osds":[1]},{"pgid":"4.1a","osds":[0]},{"pgid":"4.1b","osds":[0]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1e","osds":[0]},{"pgid":"4.20","osds":[0]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.26","osds":[0]},{"pgid":"4.27","osds":[1]},{"pgid":"4.29","osds":[0]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[0]},{"pgid":"4.31","osds":[1]},{"pgid":"4.34","osds":[1]},{"pgid":"4.38","osds":[0]},{"pgid":"4.39","osds":[0]},{"pgid":"4.3a","osds":[0]},{"pgid":"4.3c","osds":[0]},{"pgid":"4.3d","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T16:03:15.471 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-11T16:03:15.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T16:03:15.754 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:15.754 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":82,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T16:03:15.148553+0000","last_up_change":"2024-06-11T16:03:00.063621+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":71,"up_thru":81,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6801","nonce":3596598173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6803","nonce":3596598173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6807","nonce":3596598173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6805","nonce":3596598173}]},"public_addr":"172.21.15.171:6801/3596598173","cluster_addr":"172.21.15.171:6803/3596598173","heartbeat_back_addr":"172.21.15.171:6807/3596598173","heartbeat_front_addr":"172.21.15.171:6805/3596598173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":37}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[1]},{"pgid":"4.0","osds":[0]},{"pgid":"4.1","osds":[1]},{"pgid":"4.2","osds":[1]},{"pgid":"4.3","osds":[1]},{"pgid":"4.5","osds":[1]},{"pgid":"4.a","osds":[0]},{"pgid":"4.b","osds":[0]},{"pgid":"4.c","osds":[0]},{"pgid":"4.d","osds":[1]},{"pgid":"4.e","osds":[0,1]},{"pgid":"4.11","osds":[0]},{"pgid":"4.13","osds":[1]},{"pgid":"4.1a","osds":[0]},{"pgid":"4.1b","osds":[0]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1e","osds":[0]},{"pgid":"4.20","osds":[0]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.26","osds":[0]},{"pgid":"4.27","osds":[1]},{"pgid":"4.29","osds":[0]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[0]},{"pgid":"4.31","osds":[1]},{"pgid":"4.34","osds":[1]},{"pgid":"4.38","osds":[0]},{"pgid":"4.39","osds":[0]},{"pgid":"4.3a","osds":[0]},{"pgid":"4.3c","osds":[0]},{"pgid":"4.3d","osds":[1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T16:03:15.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-11T16:03:15.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-11T16:03:15.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-11T16:03:15.908 INFO:teuthology.orchestra.run.smithi089.stdout:304942678021 2024-06-11T16:03:15.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T16:03:15.926 INFO:teuthology.orchestra.run.smithi089.stdout:34359738426 2024-06-11T16:03:15.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T16:03:15.928 INFO:teuthology.orchestra.run.smithi089.stdout:34359738426 2024-06-11T16:03:15.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T16:03:16.226 INFO:teuthology.orchestra.run.smithi089.stdout:304942678020 2024-06-11T16:03:16.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678021 got 304942678020 for osd.2 2024-06-11T16:03:16.273 INFO:teuthology.orchestra.run.smithi089.stdout:34359738425 2024-06-11T16:03:16.285 INFO:teuthology.orchestra.run.smithi089.stdout:34359738425 2024-06-11T16:03:16.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738425 for osd.0 2024-06-11T16:03:16.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738425 for osd.1 2024-06-11T16:03:17.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T16:03:17.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T16:03:17.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T16:03:17.564 INFO:teuthology.orchestra.run.smithi089.stdout:304942678020 2024-06-11T16:03:17.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678021 got 304942678020 for osd.2 2024-06-11T16:03:17.598 INFO:teuthology.orchestra.run.smithi089.stdout:34359738425 2024-06-11T16:03:17.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738425 for osd.0 2024-06-11T16:03:17.644 INFO:teuthology.orchestra.run.smithi089.stdout:34359738425 2024-06-11T16:03:17.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738425 for osd.1 2024-06-11T16:03:18.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-11T16:03:18.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-11T16:03:18.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-11T16:03:18.898 INFO:teuthology.orchestra.run.smithi089.stdout:304942678021 2024-06-11T16:03:18.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678021 got 304942678021 for osd.2 2024-06-11T16:03:18.912 DEBUG:teuthology.parallel:result is None 2024-06-11T16:03:18.929 INFO:teuthology.orchestra.run.smithi089.stdout:34359738426 2024-06-11T16:03:18.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738426 for osd.0 2024-06-11T16:03:18.943 DEBUG:teuthology.parallel:result is None 2024-06-11T16:03:18.965 INFO:teuthology.orchestra.run.smithi089.stdout:34359738426 2024-06-11T16:03:18.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738426 got 34359738426 for osd.1 2024-06-11T16:03:18.978 DEBUG:teuthology.parallel:result is None 2024-06-11T16:03:18.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-06-11T16:03:18.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:19.307 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:19.309 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:19.319 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-06-11T16:03:19.136796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2208,"num_bytes_recovered":39475596,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":232320,"kb_used_data":89676,"kb_used_omap":10,"kb_used_meta":142581,"kb_avail":282883200,"statfs":{"total":289910292480,"available":289672396800,"internally_reserved":0,"allocated":91828224,"data_stored":148696712,"data_compressed":17746905,"data_compressed_allocated":20983808,"data_compressed_original":101699584,"omap_allocated":10353,"internal_metadata":146003855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1122,"num_bytes_recovered":24166998,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.985627"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179194+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:17.179194+0000","last_peered":"2024-06-11T16:03:17.179194+0000","last_clean":"2024-06-11T16:03:17.179194+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:17.179194+0000","last_undegraded":"2024-06-11T16:03:17.179194+0000","last_fullsized":"2024-06-11T16:03:17.179194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178683+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:17.178683+0000","last_peered":"2024-06-11T16:03:17.178683+0000","last_clean":"2024-06-11T16:03:17.178683+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:17.178683+0000","last_undegraded":"2024-06-11T16:03:17.178683+0000","last_fullsized":"2024-06-11T16:03:17.178683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":236,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.320321+0000","last_change":"2024-06-11T16:03:19.078765+0000","last_active":"2024-06-11T16:03:19.078765+0000","last_peered":"2024-06-11T16:03:17.320321+0000","last_clean":"2024-06-11T16:00:50.272256+0000","last_became_active":"2024-06-11T16:03:16.189967+0000","last_became_peered":"2024-06-11T16:03:16.189967+0000","last_unstale":"2024-06-11T16:03:17.320321+0000","last_undegraded":"2024-06-11T16:03:17.320321+0000","last_fullsized":"2024-06-11T16:03:16.159979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":231,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:18.069662+0000","last_change":"2024-06-11T16:03:19.078732+0000","last_active":"2024-06-11T16:03:19.078732+0000","last_peered":"2024-06-11T16:03:18.069662+0000","last_clean":"2024-06-11T16:03:13.145938+0000","last_became_active":"2024-06-11T16:03:16.186231+0000","last_became_peered":"2024-06-11T16:03:16.186231+0000","last_unstale":"2024-06-11T16:03:18.069662+0000","last_undegraded":"2024-06-11T16:03:18.069662+0000","last_fullsized":"2024-06-11T16:03:16.160424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":277,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179405+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:17.179405+0000","last_peered":"2024-06-11T16:03:17.179405+0000","last_clean":"2024-06-11T16:03:17.179405+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:17.179405+0000","last_undegraded":"2024-06-11T16:03:17.179405+0000","last_fullsized":"2024-06-11T16:03:17.179405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183982+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:18.183982+0000","last_peered":"2024-06-11T16:03:18.183982+0000","last_clean":"2024-06-11T16:03:18.183982+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:18.183982+0000","last_undegraded":"2024-06-11T16:03:18.183982+0000","last_fullsized":"2024-06-11T16:03:18.183982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183991+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:18.183991+0000","last_peered":"2024-06-11T16:03:18.183991+0000","last_clean":"2024-06-11T16:03:18.183991+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:18.183991+0000","last_undegraded":"2024-06-11T16:03:18.183991+0000","last_fullsized":"2024-06-11T16:03:18.183991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":238,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180398+0000","last_change":"2024-06-11T16:03:16.189003+0000","last_active":"2024-06-11T16:03:17.180398+0000","last_peered":"2024-06-11T16:03:17.180398+0000","last_clean":"2024-06-11T16:03:13.142708+0000","last_became_active":"2024-06-11T16:03:16.188468+0000","last_became_peered":"2024-06-11T16:03:16.188468+0000","last_unstale":"2024-06-11T16:03:17.180398+0000","last_undegraded":"2024-06-11T16:03:16.162443+0000","last_fullsized":"2024-06-11T16:03:16.160406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":313,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180669+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:17.180669+0000","last_peered":"2024-06-11T16:03:17.180669+0000","last_clean":"2024-06-11T16:03:17.180669+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:17.180669+0000","last_undegraded":"2024-06-11T16:03:17.180669+0000","last_fullsized":"2024-06-11T16:03:17.180669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":226,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178742+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:17.178742+0000","last_peered":"2024-06-11T16:03:17.178742+0000","last_clean":"2024-06-11T16:03:17.178742+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:17.178742+0000","last_undegraded":"2024-06-11T16:03:17.178742+0000","last_fullsized":"2024-06-11T16:03:17.178742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":242,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180724+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:18.180724+0000","last_peered":"2024-06-11T16:03:18.180724+0000","last_clean":"2024-06-11T16:03:18.180724+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:18.180724+0000","last_undegraded":"2024-06-11T16:03:18.180724+0000","last_fullsized":"2024-06-11T16:03:18.180724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":374,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.688057+0000","last_change":"2024-06-11T16:03:17.688201+0000","last_active":"2024-06-11T16:03:17.688057+0000","last_peered":"2024-06-11T16:03:17.688057+0000","last_clean":"2024-06-11T16:00:49.274163+0000","last_became_active":"2024-06-11T16:03:16.190933+0000","last_became_peered":"2024-06-11T16:03:16.190933+0000","last_unstale":"2024-06-11T16:03:17.688057+0000","last_undegraded":"2024-06-11T16:03:17.688057+0000","last_fullsized":"2024-06-11T16:03:16.164984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179312+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:17.179312+0000","last_peered":"2024-06-11T16:03:17.179312+0000","last_clean":"2024-06-11T16:03:17.179312+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:17.179312+0000","last_undegraded":"2024-06-11T16:03:17.179312+0000","last_fullsized":"2024-06-11T16:03:17.179312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":273,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179296+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:18.179296+0000","last_peered":"2024-06-11T16:03:18.179296+0000","last_clean":"2024-06-11T16:03:18.179296+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:18.179296+0000","last_undegraded":"2024-06-11T16:03:18.179296+0000","last_fullsized":"2024-06-11T16:03:18.179296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184216+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:18.184216+0000","last_peered":"2024-06-11T16:03:18.184216+0000","last_clean":"2024-06-11T16:03:18.184216+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:18.184216+0000","last_undegraded":"2024-06-11T16:03:18.184216+0000","last_fullsized":"2024-06-11T16:03:18.184216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179647+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:18.179647+0000","last_peered":"2024-06-11T16:03:18.179647+0000","last_clean":"2024-06-11T16:03:18.179647+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:18.179647+0000","last_undegraded":"2024-06-11T16:03:18.179647+0000","last_fullsized":"2024-06-11T16:03:18.179647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":306,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181195+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:17.181195+0000","last_peered":"2024-06-11T16:03:17.181195+0000","last_clean":"2024-06-11T16:03:17.181195+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:17.181195+0000","last_undegraded":"2024-06-11T16:03:17.181195+0000","last_fullsized":"2024-06-11T16:03:17.181195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178840+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:17.178840+0000","last_peered":"2024-06-11T16:03:17.178840+0000","last_clean":"2024-06-11T16:03:17.178840+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:17.178840+0000","last_undegraded":"2024-06-11T16:03:17.178840+0000","last_fullsized":"2024-06-11T16:03:17.178840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180231+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:17.180231+0000","last_peered":"2024-06-11T16:03:17.180231+0000","last_clean":"2024-06-11T16:03:17.180231+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:17.180231+0000","last_undegraded":"2024-06-11T16:03:17.180231+0000","last_fullsized":"2024-06-11T16:03:17.180231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179717+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:18.179717+0000","last_peered":"2024-06-11T16:03:18.179717+0000","last_clean":"2024-06-11T16:03:18.179717+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:18.179717+0000","last_undegraded":"2024-06-11T16:03:18.179717+0000","last_fullsized":"2024-06-11T16:03:18.179717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":260,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.197243+0000","last_change":"2024-06-11T16:03:19.078723+0000","last_active":"2024-06-11T16:03:19.078723+0000","last_peered":"2024-06-11T16:03:17.197243+0000","last_clean":"2024-06-11T16:03:13.145303+0000","last_became_active":"2024-06-11T16:03:16.182774+0000","last_became_peered":"2024-06-11T16:03:16.182774+0000","last_unstale":"2024-06-11T16:03:17.197243+0000","last_undegraded":"2024-06-11T16:03:17.197243+0000","last_fullsized":"2024-06-11T16:03:16.158479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":215,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178382+0000","last_change":"2024-06-11T16:03:16.192703+0000","last_active":"2024-06-11T16:03:17.178382+0000","last_peered":"2024-06-11T16:03:17.178382+0000","last_clean":"2024-06-11T16:00:49.984702+0000","last_became_active":"2024-06-11T16:03:16.191902+0000","last_became_peered":"2024-06-11T16:03:16.191902+0000","last_unstale":"2024-06-11T16:03:17.178382+0000","last_undegraded":"2024-06-11T16:03:16.173719+0000","last_fullsized":"2024-06-11T16:03:16.162453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":107,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":61}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":521,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.579274+0000","last_change":"2024-06-11T16:03:17.579430+0000","last_active":"2024-06-11T16:03:17.579274+0000","last_peered":"2024-06-11T16:03:17.579274+0000","last_clean":"2024-06-11T16:03:13.142079+0000","last_became_active":"2024-06-11T16:03:16.185012+0000","last_became_peered":"2024-06-11T16:03:16.185012+0000","last_unstale":"2024-06-11T16:03:17.579274+0000","last_undegraded":"2024-06-11T16:03:17.579274+0000","last_fullsized":"2024-06-11T16:03:16.164051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":260,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177689+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:17.177689+0000","last_peered":"2024-06-11T16:03:17.177689+0000","last_clean":"2024-06-11T16:03:17.177689+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:17.177689+0000","last_undegraded":"2024-06-11T16:03:17.177689+0000","last_fullsized":"2024-06-11T16:03:17.177689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":412,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.501972+0000","last_change":"2024-06-11T16:03:17.179185+0000","last_active":"2024-06-11T16:03:17.179185+0000","last_peered":"2024-06-11T16:03:16.501972+0000","last_clean":"2024-06-11T16:00:48.876123+0000","last_became_active":"2024-06-11T16:03:16.189506+0000","last_became_peered":"2024-06-11T16:03:16.189506+0000","last_unstale":"2024-06-11T16:03:16.501972+0000","last_undegraded":"2024-06-11T16:03:16.501972+0000","last_fullsized":"2024-06-11T16:03:16.161578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":350,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180978+0000","last_change":"2024-06-11T16:03:16.189203+0000","last_active":"2024-06-11T16:03:17.180978+0000","last_peered":"2024-06-11T16:03:17.180978+0000","last_clean":"2024-06-11T16:03:13.145775+0000","last_became_active":"2024-06-11T16:03:16.188275+0000","last_became_peered":"2024-06-11T16:03:16.188275+0000","last_unstale":"2024-06-11T16:03:17.180978+0000","last_undegraded":"2024-06-11T16:03:16.167633+0000","last_fullsized":"2024-06-11T16:03:16.165841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":211,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180349+0000","last_change":"2024-06-11T16:03:16.195303+0000","last_active":"2024-06-11T16:03:17.180349+0000","last_peered":"2024-06-11T16:03:17.180349+0000","last_clean":"2024-06-11T16:00:51.884795+0000","last_became_active":"2024-06-11T16:03:16.194759+0000","last_became_peered":"2024-06-11T16:03:16.194759+0000","last_unstale":"2024-06-11T16:03:17.180349+0000","last_undegraded":"2024-06-11T16:03:16.179951+0000","last_fullsized":"2024-06-11T16:03:16.178957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178832+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:17.178832+0000","last_peered":"2024-06-11T16:03:17.178832+0000","last_clean":"2024-06-11T16:03:17.178832+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:17.178832+0000","last_undegraded":"2024-06-11T16:03:17.178832+0000","last_fullsized":"2024-06-11T16:03:17.178832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179463+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:17.179463+0000","last_peered":"2024-06-11T16:03:17.179463+0000","last_clean":"2024-06-11T16:03:17.179463+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:17.179463+0000","last_undegraded":"2024-06-11T16:03:17.179463+0000","last_fullsized":"2024-06-11T16:03:17.179463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":235,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180275+0000","last_change":"2024-06-11T16:03:16.194106+0000","last_active":"2024-06-11T16:03:17.180275+0000","last_peered":"2024-06-11T16:03:17.180275+0000","last_clean":"2024-06-11T16:00:49.278755+0000","last_became_active":"2024-06-11T16:03:16.193259+0000","last_became_peered":"2024-06-11T16:03:16.193259+0000","last_unstale":"2024-06-11T16:03:17.180275+0000","last_undegraded":"2024-06-11T16:03:16.177585+0000","last_fullsized":"2024-06-11T16:03:16.175596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":67}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179882+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:17.179882+0000","last_peered":"2024-06-11T16:03:17.179882+0000","last_clean":"2024-06-11T16:03:17.179882+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:17.179882+0000","last_undegraded":"2024-06-11T16:03:17.179882+0000","last_fullsized":"2024-06-11T16:03:17.179882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184212+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:18.184212+0000","last_peered":"2024-06-11T16:03:18.184212+0000","last_clean":"2024-06-11T16:03:18.184212+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:18.184212+0000","last_undegraded":"2024-06-11T16:03:18.184212+0000","last_fullsized":"2024-06-11T16:03:18.184212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178619+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:17.178619+0000","last_peered":"2024-06-11T16:03:17.178619+0000","last_clean":"2024-06-11T16:03:17.178619+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:17.178619+0000","last_undegraded":"2024-06-11T16:03:17.178619+0000","last_fullsized":"2024-06-11T16:03:17.178619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178880+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:18.178880+0000","last_peered":"2024-06-11T16:03:18.178880+0000","last_clean":"2024-06-11T16:03:18.178880+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:18.178880+0000","last_undegraded":"2024-06-11T16:03:18.178880+0000","last_fullsized":"2024-06-11T16:03:18.178880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179781+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:17.179781+0000","last_peered":"2024-06-11T16:03:17.179781+0000","last_clean":"2024-06-11T16:03:17.179781+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:17.179781+0000","last_undegraded":"2024-06-11T16:03:17.179781+0000","last_fullsized":"2024-06-11T16:03:17.179781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180574+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:17.180574+0000","last_peered":"2024-06-11T16:03:17.180574+0000","last_clean":"2024-06-11T16:03:17.180574+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:17.180574+0000","last_undegraded":"2024-06-11T16:03:17.180574+0000","last_fullsized":"2024-06-11T16:03:17.180574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182098+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:17.182098+0000","last_peered":"2024-06-11T16:03:17.182098+0000","last_clean":"2024-06-11T16:03:17.182098+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:17.182098+0000","last_undegraded":"2024-06-11T16:03:17.182098+0000","last_fullsized":"2024-06-11T16:03:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179206+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:17.179206+0000","last_peered":"2024-06-11T16:03:17.179206+0000","last_clean":"2024-06-11T16:03:17.179206+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:17.179206+0000","last_undegraded":"2024-06-11T16:03:17.179206+0000","last_fullsized":"2024-06-11T16:03:17.179206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180961+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:17.180961+0000","last_peered":"2024-06-11T16:03:17.180961+0000","last_clean":"2024-06-11T16:03:17.180961+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:17.180961+0000","last_undegraded":"2024-06-11T16:03:17.180961+0000","last_fullsized":"2024-06-11T16:03:17.180961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179354+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:18.179354+0000","last_peered":"2024-06-11T16:03:18.179354+0000","last_clean":"2024-06-11T16:03:18.179354+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:18.179354+0000","last_undegraded":"2024-06-11T16:03:18.179354+0000","last_fullsized":"2024-06-11T16:03:18.179354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179114+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:18.179114+0000","last_peered":"2024-06-11T16:03:18.179114+0000","last_clean":"2024-06-11T16:03:18.179114+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:18.179114+0000","last_undegraded":"2024-06-11T16:03:18.179114+0000","last_fullsized":"2024-06-11T16:03:18.179114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177782+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:17.177782+0000","last_peered":"2024-06-11T16:03:17.177782+0000","last_clean":"2024-06-11T16:03:17.177782+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:17.177782+0000","last_undegraded":"2024-06-11T16:03:17.177782+0000","last_fullsized":"2024-06-11T16:03:17.177782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178957+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:17.178957+0000","last_peered":"2024-06-11T16:03:17.178957+0000","last_clean":"2024-06-11T16:03:17.178957+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:17.178957+0000","last_undegraded":"2024-06-11T16:03:17.178957+0000","last_fullsized":"2024-06-11T16:03:17.178957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":267,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178333+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:17.178333+0000","last_peered":"2024-06-11T16:03:17.178333+0000","last_clean":"2024-06-11T16:03:17.178333+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:17.178333+0000","last_undegraded":"2024-06-11T16:03:17.178333+0000","last_fullsized":"2024-06-11T16:03:17.178333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179955+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:18.179955+0000","last_peered":"2024-06-11T16:03:18.179955+0000","last_clean":"2024-06-11T16:03:18.179955+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:18.179955+0000","last_undegraded":"2024-06-11T16:03:18.179955+0000","last_fullsized":"2024-06-11T16:03:18.179955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":270,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.181198+0000","last_change":"2024-06-11T16:03:16.192499+0000","last_active":"2024-06-11T16:03:17.181198+0000","last_peered":"2024-06-11T16:03:17.181198+0000","last_clean":"2024-06-11T16:03:13.145765+0000","last_became_active":"2024-06-11T16:03:16.191847+0000","last_became_peered":"2024-06-11T16:03:16.191847+0000","last_unstale":"2024-06-11T16:03:17.181198+0000","last_undegraded":"2024-06-11T16:03:16.166138+0000","last_fullsized":"2024-06-11T16:03:16.164953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179537+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:18.179537+0000","last_peered":"2024-06-11T16:03:18.179537+0000","last_clean":"2024-06-11T16:03:18.179537+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:18.179537+0000","last_undegraded":"2024-06-11T16:03:18.179537+0000","last_fullsized":"2024-06-11T16:03:18.179537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":317,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179491+0000","last_change":"2024-06-11T16:03:16.191512+0000","last_active":"2024-06-11T16:03:17.179491+0000","last_peered":"2024-06-11T16:03:17.179491+0000","last_clean":"2024-06-11T16:03:13.144603+0000","last_became_active":"2024-06-11T16:03:16.190589+0000","last_became_peered":"2024-06-11T16:03:16.190589+0000","last_unstale":"2024-06-11T16:03:17.179491+0000","last_undegraded":"2024-06-11T16:03:16.168532+0000","last_fullsized":"2024-06-11T16:03:16.166580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179803+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:17.179803+0000","last_peered":"2024-06-11T16:03:17.179803+0000","last_clean":"2024-06-11T16:03:17.179803+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:17.179803+0000","last_undegraded":"2024-06-11T16:03:17.179803+0000","last_fullsized":"2024-06-11T16:03:17.179803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":281,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179286+0000","last_change":"2024-06-11T16:03:16.188586+0000","last_active":"2024-06-11T16:03:17.179286+0000","last_peered":"2024-06-11T16:03:17.179286+0000","last_clean":"2024-06-11T16:03:13.144491+0000","last_became_active":"2024-06-11T16:03:16.187988+0000","last_became_peered":"2024-06-11T16:03:16.187988+0000","last_unstale":"2024-06-11T16:03:17.179286+0000","last_undegraded":"2024-06-11T16:03:16.165185+0000","last_fullsized":"2024-06-11T16:03:16.159943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178823+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:18.178823+0000","last_peered":"2024-06-11T16:03:18.178823+0000","last_clean":"2024-06-11T16:03:18.178823+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:18.178823+0000","last_undegraded":"2024-06-11T16:03:18.178823+0000","last_fullsized":"2024-06-11T16:03:18.178823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":267,"reported_epoch":84,"state":"active+recovering+undersized+remapped","last_fresh":"2024-06-11T16:03:18.128201+0000","last_change":"2024-06-11T16:03:18.071702+0000","last_active":"2024-06-11T16:03:18.128201+0000","last_peered":"2024-06-11T16:03:18.128201+0000","last_clean":"2024-06-11T16:00:54.881776+0000","last_became_active":"2024-06-11T16:03:16.191861+0000","last_became_peered":"2024-06-11T16:03:16.191861+0000","last_unstale":"2024-06-11T16:03:18.128201+0000","last_undegraded":"2024-06-11T16:03:18.128201+0000","last_fullsized":"2024-06-11T16:03:16.175219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":25864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":34},{"shards":"1","objects":24}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179338+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:17.179338+0000","last_peered":"2024-06-11T16:03:17.179338+0000","last_clean":"2024-06-11T16:03:17.179338+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:17.179338+0000","last_undegraded":"2024-06-11T16:03:17.179338+0000","last_fullsized":"2024-06-11T16:03:17.179338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":224,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.440008+0000","last_change":"2024-06-11T16:03:19.078787+0000","last_active":"2024-06-11T16:03:19.078787+0000","last_peered":"2024-06-11T16:03:17.440008+0000","last_clean":"2024-06-11T16:03:12.135478+0000","last_became_active":"2024-06-11T16:03:16.184920+0000","last_became_peered":"2024-06-11T16:03:16.184920+0000","last_unstale":"2024-06-11T16:03:17.440008+0000","last_undegraded":"2024-06-11T16:03:17.440008+0000","last_fullsized":"2024-06-11T16:03:17.440008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178361+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:17.178361+0000","last_peered":"2024-06-11T16:03:17.178361+0000","last_clean":"2024-06-11T16:03:17.178361+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:17.178361+0000","last_undegraded":"2024-06-11T16:03:17.178361+0000","last_fullsized":"2024-06-11T16:03:17.178361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180989+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:17.180989+0000","last_peered":"2024-06-11T16:03:17.180989+0000","last_clean":"2024-06-11T16:03:17.180989+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:17.180989+0000","last_undegraded":"2024-06-11T16:03:17.180989+0000","last_fullsized":"2024-06-11T16:03:17.180989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":239,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.443714+0000","last_change":"2024-06-11T16:03:19.078630+0000","last_active":"2024-06-11T16:03:19.078630+0000","last_peered":"2024-06-11T16:03:17.443714+0000","last_clean":"2024-06-11T15:58:53.120953+0000","last_became_active":"2024-06-11T16:03:16.191135+0000","last_became_peered":"2024-06-11T16:03:16.191135+0000","last_unstale":"2024-06-11T16:03:17.443714+0000","last_undegraded":"2024-06-11T16:03:17.443714+0000","last_fullsized":"2024-06-11T16:03:16.164894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178783+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:18.178783+0000","last_peered":"2024-06-11T16:03:18.178783+0000","last_clean":"2024-06-11T16:03:18.178783+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:18.178783+0000","last_undegraded":"2024-06-11T16:03:18.178783+0000","last_fullsized":"2024-06-11T16:03:18.178783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":170,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181497+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:17.181497+0000","last_peered":"2024-06-11T16:03:17.181497+0000","last_clean":"2024-06-11T16:03:17.181497+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:17.181497+0000","last_undegraded":"2024-06-11T16:03:17.181497+0000","last_fullsized":"2024-06-11T16:03:17.181497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":202,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.948980+0000","last_change":"2024-06-11T16:03:19.078773+0000","last_active":"2024-06-11T16:03:19.078773+0000","last_peered":"2024-06-11T16:03:17.948980+0000","last_clean":"2024-06-11T16:00:54.882186+0000","last_became_active":"2024-06-11T16:03:16.191785+0000","last_became_peered":"2024-06-11T16:03:16.191785+0000","last_unstale":"2024-06-11T16:03:17.948980+0000","last_undegraded":"2024-06-11T16:03:17.948980+0000","last_fullsized":"2024-06-11T16:03:16.162689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179560+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:18.179560+0000","last_peered":"2024-06-11T16:03:18.179560+0000","last_clean":"2024-06-11T16:03:18.179560+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:18.179560+0000","last_undegraded":"2024-06-11T16:03:18.179560+0000","last_fullsized":"2024-06-11T16:03:18.179560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":236,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180143+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:17.180143+0000","last_peered":"2024-06-11T16:03:17.180143+0000","last_clean":"2024-06-11T16:03:17.180143+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:17.180143+0000","last_undegraded":"2024-06-11T16:03:17.180143+0000","last_fullsized":"2024-06-11T16:03:17.180143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178783+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:17.178783+0000","last_peered":"2024-06-11T16:03:17.178783+0000","last_clean":"2024-06-11T16:03:17.178783+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:17.178783+0000","last_undegraded":"2024-06-11T16:03:17.178783+0000","last_fullsized":"2024-06-11T16:03:17.178783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180383+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:17.180383+0000","last_peered":"2024-06-11T16:03:17.180383+0000","last_clean":"2024-06-11T16:03:17.180383+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:17.180383+0000","last_undegraded":"2024-06-11T16:03:17.180383+0000","last_fullsized":"2024-06-11T16:03:17.180383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178212+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:17.178212+0000","last_peered":"2024-06-11T16:03:17.178212+0000","last_clean":"2024-06-11T16:03:17.178212+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:17.178212+0000","last_undegraded":"2024-06-11T16:03:17.178212+0000","last_fullsized":"2024-06-11T16:03:17.178212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181052+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:17.181052+0000","last_peered":"2024-06-11T16:03:17.181052+0000","last_clean":"2024-06-11T16:03:17.181052+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:17.181052+0000","last_undegraded":"2024-06-11T16:03:17.181052+0000","last_fullsized":"2024-06-11T16:03:17.181052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178739+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:18.178739+0000","last_peered":"2024-06-11T16:03:18.178739+0000","last_clean":"2024-06-11T16:03:18.178739+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:18.178739+0000","last_undegraded":"2024-06-11T16:03:18.178739+0000","last_fullsized":"2024-06-11T16:03:18.178739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178519+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:18.178519+0000","last_peered":"2024-06-11T16:03:18.178519+0000","last_clean":"2024-06-11T16:03:18.178519+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:18.178519+0000","last_undegraded":"2024-06-11T16:03:18.178519+0000","last_fullsized":"2024-06-11T16:03:18.178519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180246+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:17.180246+0000","last_peered":"2024-06-11T16:03:17.180246+0000","last_clean":"2024-06-11T16:03:17.180246+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:17.180246+0000","last_undegraded":"2024-06-11T16:03:17.180246+0000","last_fullsized":"2024-06-11T16:03:17.180246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180209+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:18.180209+0000","last_peered":"2024-06-11T16:03:18.180209+0000","last_clean":"2024-06-11T16:03:18.180209+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:18.180209+0000","last_undegraded":"2024-06-11T16:03:18.180209+0000","last_fullsized":"2024-06-11T16:03:18.180209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180464+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:17.180464+0000","last_peered":"2024-06-11T16:03:17.180464+0000","last_clean":"2024-06-11T16:03:17.180464+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:17.180464+0000","last_undegraded":"2024-06-11T16:03:17.180464+0000","last_fullsized":"2024-06-11T16:03:17.180464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":209,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179690+0000","last_change":"2024-06-11T16:03:16.193053+0000","last_active":"2024-06-11T16:03:17.179690+0000","last_peered":"2024-06-11T16:03:17.179690+0000","last_clean":"2024-06-11T16:00:49.275319+0000","last_became_active":"2024-06-11T16:03:16.192031+0000","last_became_peered":"2024-06-11T16:03:16.192031+0000","last_unstale":"2024-06-11T16:03:17.179690+0000","last_undegraded":"2024-06-11T16:03:16.177017+0000","last_fullsized":"2024-06-11T16:03:16.175201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":40}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180359+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:17.180359+0000","last_peered":"2024-06-11T16:03:17.180359+0000","last_clean":"2024-06-11T16:03:17.180359+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:17.180359+0000","last_undegraded":"2024-06-11T16:03:17.180359+0000","last_fullsized":"2024-06-11T16:03:17.180359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180454+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:17.180454+0000","last_peered":"2024-06-11T16:03:17.180454+0000","last_clean":"2024-06-11T16:03:17.180454+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:17.180454+0000","last_undegraded":"2024-06-11T16:03:17.180454+0000","last_fullsized":"2024-06-11T16:03:17.180454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":232,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179384+0000","last_change":"2024-06-11T16:03:16.193264+0000","last_active":"2024-06-11T16:03:17.179384+0000","last_peered":"2024-06-11T16:03:17.179384+0000","last_clean":"2024-06-11T16:00:51.883199+0000","last_became_active":"2024-06-11T16:03:16.192397+0000","last_became_peered":"2024-06-11T16:03:16.192397+0000","last_unstale":"2024-06-11T16:03:17.179384+0000","last_undegraded":"2024-06-11T16:03:16.178925+0000","last_fullsized":"2024-06-11T16:03:16.176807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181264+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:17.181264+0000","last_peered":"2024-06-11T16:03:17.181264+0000","last_clean":"2024-06-11T16:03:17.181264+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:17.181264+0000","last_undegraded":"2024-06-11T16:03:17.181264+0000","last_fullsized":"2024-06-11T16:03:17.181264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182211+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:17.182211+0000","last_peered":"2024-06-11T16:03:17.182211+0000","last_clean":"2024-06-11T16:03:17.182211+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:17.182211+0000","last_undegraded":"2024-06-11T16:03:17.182211+0000","last_fullsized":"2024-06-11T16:03:17.182211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":300,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180679+0000","last_change":"2024-06-11T16:03:16.190115+0000","last_active":"2024-06-11T16:03:17.180679+0000","last_peered":"2024-06-11T16:03:17.180679+0000","last_clean":"2024-06-11T16:03:13.144927+0000","last_became_active":"2024-06-11T16:03:16.189305+0000","last_became_peered":"2024-06-11T16:03:16.189305+0000","last_unstale":"2024-06-11T16:03:17.180679+0000","last_undegraded":"2024-06-11T16:03:16.167879+0000","last_fullsized":"2024-06-11T16:03:16.164999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":202,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182140+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:17.182140+0000","last_peered":"2024-06-11T16:03:17.182140+0000","last_clean":"2024-06-11T16:03:17.182140+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:17.182140+0000","last_undegraded":"2024-06-11T16:03:17.182140+0000","last_fullsized":"2024-06-11T16:03:17.182140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179070+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:18.179070+0000","last_peered":"2024-06-11T16:03:18.179070+0000","last_clean":"2024-06-11T16:03:18.179070+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:18.179070+0000","last_undegraded":"2024-06-11T16:03:18.179070+0000","last_fullsized":"2024-06-11T16:03:18.179070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":380,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.776931+0000","last_change":"2024-06-11T16:03:17.179022+0000","last_active":"2024-06-11T16:03:17.179022+0000","last_peered":"2024-06-11T16:03:16.776931+0000","last_clean":"2024-06-11T16:00:51.883048+0000","last_became_active":"2024-06-11T16:03:16.190080+0000","last_became_peered":"2024-06-11T16:03:16.190080+0000","last_unstale":"2024-06-11T16:03:16.776931+0000","last_undegraded":"2024-06-11T16:03:16.776931+0000","last_fullsized":"2024-06-11T16:03:16.162599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":203,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178020+0000","last_change":"2024-06-11T16:03:16.193145+0000","last_active":"2024-06-11T16:03:17.178020+0000","last_peered":"2024-06-11T16:03:17.178020+0000","last_clean":"2024-06-11T16:00:49.663987+0000","last_became_active":"2024-06-11T16:03:16.192482+0000","last_became_peered":"2024-06-11T16:03:16.192482+0000","last_unstale":"2024-06-11T16:03:17.178020+0000","last_undegraded":"2024-06-11T16:03:16.179441+0000","last_fullsized":"2024-06-11T16:03:16.178454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179630+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:18.179630+0000","last_peered":"2024-06-11T16:03:18.179630+0000","last_clean":"2024-06-11T16:03:18.179630+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:18.179630+0000","last_undegraded":"2024-06-11T16:03:18.179630+0000","last_fullsized":"2024-06-11T16:03:18.179630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":288,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180302+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:17.180302+0000","last_peered":"2024-06-11T16:03:17.180302+0000","last_clean":"2024-06-11T16:03:17.180302+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:17.180302+0000","last_undegraded":"2024-06-11T16:03:17.180302+0000","last_fullsized":"2024-06-11T16:03:17.180302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180229+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:17.180229+0000","last_peered":"2024-06-11T16:03:17.180229+0000","last_clean":"2024-06-11T16:03:17.180229+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:17.180229+0000","last_undegraded":"2024-06-11T16:03:17.180229+0000","last_fullsized":"2024-06-11T16:03:17.180229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178653+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:18.178653+0000","last_peered":"2024-06-11T16:03:18.178653+0000","last_clean":"2024-06-11T16:03:18.178653+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:18.178653+0000","last_undegraded":"2024-06-11T16:03:18.178653+0000","last_fullsized":"2024-06-11T16:03:18.178653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":328,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179969+0000","last_change":"2024-06-11T16:03:16.187720+0000","last_active":"2024-06-11T16:03:17.179969+0000","last_peered":"2024-06-11T16:03:17.179969+0000","last_clean":"2024-06-11T16:03:13.142425+0000","last_became_active":"2024-06-11T16:03:16.186853+0000","last_became_peered":"2024-06-11T16:03:16.186853+0000","last_unstale":"2024-06-11T16:03:17.179969+0000","last_undegraded":"2024-06-11T16:03:16.166457+0000","last_fullsized":"2024-06-11T16:03:16.164143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181175+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:17.181175+0000","last_peered":"2024-06-11T16:03:17.181175+0000","last_clean":"2024-06-11T16:03:17.181175+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:17.181175+0000","last_undegraded":"2024-06-11T16:03:17.181175+0000","last_fullsized":"2024-06-11T16:03:17.181175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180557+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:17.180557+0000","last_peered":"2024-06-11T16:03:17.180557+0000","last_clean":"2024-06-11T16:03:17.180557+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:17.180557+0000","last_undegraded":"2024-06-11T16:03:17.180557+0000","last_fullsized":"2024-06-11T16:03:17.180557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179402+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:17.179402+0000","last_peered":"2024-06-11T16:03:17.179402+0000","last_clean":"2024-06-11T16:03:17.179402+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:17.179402+0000","last_undegraded":"2024-06-11T16:03:17.179402+0000","last_fullsized":"2024-06-11T16:03:17.179402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181449+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:17.181449+0000","last_peered":"2024-06-11T16:03:17.181449+0000","last_clean":"2024-06-11T16:03:17.181449+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:17.181449+0000","last_undegraded":"2024-06-11T16:03:17.181449+0000","last_fullsized":"2024-06-11T16:03:17.181449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":506,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.822590+0000","last_change":"2024-06-11T16:03:17.822806+0000","last_active":"2024-06-11T16:03:17.822590+0000","last_peered":"2024-06-11T16:03:17.822590+0000","last_clean":"2024-06-11T16:03:13.147288+0000","last_became_active":"2024-06-11T16:03:16.186444+0000","last_became_peered":"2024-06-11T16:03:16.186444+0000","last_unstale":"2024-06-11T16:03:17.822590+0000","last_undegraded":"2024-06-11T16:03:17.822590+0000","last_fullsized":"2024-06-11T16:03:16.166311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":47}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180053+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:17.180053+0000","last_peered":"2024-06-11T16:03:17.180053+0000","last_clean":"2024-06-11T16:03:17.180053+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:17.180053+0000","last_undegraded":"2024-06-11T16:03:17.180053+0000","last_fullsized":"2024-06-11T16:03:17.180053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":198,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179432+0000","last_change":"2024-06-11T16:03:16.193737+0000","last_active":"2024-06-11T16:03:17.179432+0000","last_peered":"2024-06-11T16:03:17.179432+0000","last_clean":"2024-06-11T16:00:49.783464+0000","last_became_active":"2024-06-11T16:03:16.193263+0000","last_became_peered":"2024-06-11T16:03:16.193263+0000","last_unstale":"2024-06-11T16:03:17.179432+0000","last_undegraded":"2024-06-11T16:03:16.176440+0000","last_fullsized":"2024-06-11T16:03:16.175378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180299+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:17.180299+0000","last_peered":"2024-06-11T16:03:17.180299+0000","last_clean":"2024-06-11T16:03:17.180299+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:17.180299+0000","last_undegraded":"2024-06-11T16:03:17.180299+0000","last_fullsized":"2024-06-11T16:03:17.180299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178537+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:17.178537+0000","last_peered":"2024-06-11T16:03:17.178537+0000","last_clean":"2024-06-11T16:03:17.178537+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:17.178537+0000","last_undegraded":"2024-06-11T16:03:17.178537+0000","last_fullsized":"2024-06-11T16:03:17.178537+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179505+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:17.179505+0000","last_peered":"2024-06-11T16:03:17.179505+0000","last_clean":"2024-06-11T16:03:17.179505+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:17.179505+0000","last_undegraded":"2024-06-11T16:03:17.179505+0000","last_fullsized":"2024-06-11T16:03:17.179505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":269,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179186+0000","last_change":"2024-06-11T16:03:16.191650+0000","last_active":"2024-06-11T16:03:17.179186+0000","last_peered":"2024-06-11T16:03:17.179186+0000","last_clean":"2024-06-11T16:03:13.142283+0000","last_became_active":"2024-06-11T16:03:16.190729+0000","last_became_peered":"2024-06-11T16:03:16.190729+0000","last_unstale":"2024-06-11T16:03:17.179186+0000","last_undegraded":"2024-06-11T16:03:16.166117+0000","last_fullsized":"2024-06-11T16:03:16.164379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179592+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:18.179592+0000","last_peered":"2024-06-11T16:03:18.179592+0000","last_clean":"2024-06-11T16:03:18.179592+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:18.179592+0000","last_undegraded":"2024-06-11T16:03:18.179592+0000","last_fullsized":"2024-06-11T16:03:18.179592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":267,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180520+0000","last_change":"2024-06-11T16:03:16.192319+0000","last_active":"2024-06-11T16:03:17.180520+0000","last_peered":"2024-06-11T16:03:17.180520+0000","last_clean":"2024-06-11T16:03:13.145653+0000","last_became_active":"2024-06-11T16:03:16.191660+0000","last_became_peered":"2024-06-11T16:03:16.191660+0000","last_unstale":"2024-06-11T16:03:17.180520+0000","last_undegraded":"2024-06-11T16:03:16.167404+0000","last_fullsized":"2024-06-11T16:03:16.164859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180133+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:17.180133+0000","last_peered":"2024-06-11T16:03:17.180133+0000","last_clean":"2024-06-11T16:03:17.180133+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:17.180133+0000","last_undegraded":"2024-06-11T16:03:17.180133+0000","last_fullsized":"2024-06-11T16:03:17.180133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":262,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179399+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:17.179399+0000","last_peered":"2024-06-11T16:03:17.179399+0000","last_clean":"2024-06-11T16:03:17.179399+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:17.179399+0000","last_undegraded":"2024-06-11T16:03:17.179399+0000","last_fullsized":"2024-06-11T16:03:17.179399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181607+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:17.181607+0000","last_peered":"2024-06-11T16:03:17.181607+0000","last_clean":"2024-06-11T16:03:17.181607+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:17.181607+0000","last_undegraded":"2024-06-11T16:03:17.181607+0000","last_fullsized":"2024-06-11T16:03:17.181607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":297,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179603+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:18.179603+0000","last_peered":"2024-06-11T16:03:18.179603+0000","last_clean":"2024-06-11T16:03:18.179603+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:18.179603+0000","last_undegraded":"2024-06-11T16:03:18.179603+0000","last_fullsized":"2024-06-11T16:03:18.179603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181083+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:17.181083+0000","last_peered":"2024-06-11T16:03:17.181083+0000","last_clean":"2024-06-11T16:03:17.181083+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:17.181083+0000","last_undegraded":"2024-06-11T16:03:17.181083+0000","last_fullsized":"2024-06-11T16:03:17.181083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2171,"num_bytes_recovered":8609565,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74182656,"data_stored":61283340,"data_compressed":5274910,"data_compressed_allocated":6189056,"data_compressed_original":16252928,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":84874432,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49760,"kb_used_data":22224,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94322080,"statfs":{"total":96636764160,"available":96585809920,"internally_reserved":0,"allocated":22757376,"data_stored":48965737,"data_compressed":5999773,"data_compressed_allocated":7065600,"data_compressed_original":37867520,"omap_allocated":7164,"internal_metadata":28173316},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89456,"kb_used_data":31900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94282384,"statfs":{"total":96636764160,"available":96545161216,"internally_reserved":0,"allocated":32665600,"data_stored":51358741,"data_compressed":6440081,"data_compressed_allocated":7618560,"data_compressed_original":35721216,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93104,"kb_used_data":35552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278736,"statfs":{"total":96636764160,"available":96541425664,"internally_reserved":0,"allocated":36405248,"data_stored":48372234,"data_compressed":5307051,"data_compressed_allocated":6299648,"data_compressed_original":28110848,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":21464877,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31338496,"data_stored":25976002,"data_compressed":2198540,"data_compressed_allocated":2572288,"data_compressed_original":6660096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26144768,"data_stored":20903296,"data_compressed":2015679,"data_compressed_allocated":2363392,"data_compressed_original":6131712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16699392,"data_stored":14404042,"data_compressed":1060691,"data_compressed_allocated":1253376,"data_compressed_original":3461120,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:19.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:19.647 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:19.648 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:19.658 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-06-11T16:03:19.136796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2208,"num_bytes_recovered":39475596,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":232320,"kb_used_data":89676,"kb_used_omap":10,"kb_used_meta":142581,"kb_avail":282883200,"statfs":{"total":289910292480,"available":289672396800,"internally_reserved":0,"allocated":91828224,"data_stored":148696712,"data_compressed":17746905,"data_compressed_allocated":20983808,"data_compressed_original":101699584,"omap_allocated":10353,"internal_metadata":146003855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1122,"num_bytes_recovered":24166998,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.985627"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179194+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:17.179194+0000","last_peered":"2024-06-11T16:03:17.179194+0000","last_clean":"2024-06-11T16:03:17.179194+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:17.179194+0000","last_undegraded":"2024-06-11T16:03:17.179194+0000","last_fullsized":"2024-06-11T16:03:17.179194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178683+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:17.178683+0000","last_peered":"2024-06-11T16:03:17.178683+0000","last_clean":"2024-06-11T16:03:17.178683+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:17.178683+0000","last_undegraded":"2024-06-11T16:03:17.178683+0000","last_fullsized":"2024-06-11T16:03:17.178683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":236,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.320321+0000","last_change":"2024-06-11T16:03:19.078765+0000","last_active":"2024-06-11T16:03:19.078765+0000","last_peered":"2024-06-11T16:03:17.320321+0000","last_clean":"2024-06-11T16:00:50.272256+0000","last_became_active":"2024-06-11T16:03:16.189967+0000","last_became_peered":"2024-06-11T16:03:16.189967+0000","last_unstale":"2024-06-11T16:03:17.320321+0000","last_undegraded":"2024-06-11T16:03:17.320321+0000","last_fullsized":"2024-06-11T16:03:16.159979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":231,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:18.069662+0000","last_change":"2024-06-11T16:03:19.078732+0000","last_active":"2024-06-11T16:03:19.078732+0000","last_peered":"2024-06-11T16:03:18.069662+0000","last_clean":"2024-06-11T16:03:13.145938+0000","last_became_active":"2024-06-11T16:03:16.186231+0000","last_became_peered":"2024-06-11T16:03:16.186231+0000","last_unstale":"2024-06-11T16:03:18.069662+0000","last_undegraded":"2024-06-11T16:03:18.069662+0000","last_fullsized":"2024-06-11T16:03:16.160424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":277,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179405+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:17.179405+0000","last_peered":"2024-06-11T16:03:17.179405+0000","last_clean":"2024-06-11T16:03:17.179405+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:17.179405+0000","last_undegraded":"2024-06-11T16:03:17.179405+0000","last_fullsized":"2024-06-11T16:03:17.179405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183982+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:18.183982+0000","last_peered":"2024-06-11T16:03:18.183982+0000","last_clean":"2024-06-11T16:03:18.183982+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:18.183982+0000","last_undegraded":"2024-06-11T16:03:18.183982+0000","last_fullsized":"2024-06-11T16:03:18.183982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183991+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:18.183991+0000","last_peered":"2024-06-11T16:03:18.183991+0000","last_clean":"2024-06-11T16:03:18.183991+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:18.183991+0000","last_undegraded":"2024-06-11T16:03:18.183991+0000","last_fullsized":"2024-06-11T16:03:18.183991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":238,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180398+0000","last_change":"2024-06-11T16:03:16.189003+0000","last_active":"2024-06-11T16:03:17.180398+0000","last_peered":"2024-06-11T16:03:17.180398+0000","last_clean":"2024-06-11T16:03:13.142708+0000","last_became_active":"2024-06-11T16:03:16.188468+0000","last_became_peered":"2024-06-11T16:03:16.188468+0000","last_unstale":"2024-06-11T16:03:17.180398+0000","last_undegraded":"2024-06-11T16:03:16.162443+0000","last_fullsized":"2024-06-11T16:03:16.160406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":313,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180669+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:17.180669+0000","last_peered":"2024-06-11T16:03:17.180669+0000","last_clean":"2024-06-11T16:03:17.180669+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:17.180669+0000","last_undegraded":"2024-06-11T16:03:17.180669+0000","last_fullsized":"2024-06-11T16:03:17.180669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":226,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178742+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:17.178742+0000","last_peered":"2024-06-11T16:03:17.178742+0000","last_clean":"2024-06-11T16:03:17.178742+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:17.178742+0000","last_undegraded":"2024-06-11T16:03:17.178742+0000","last_fullsized":"2024-06-11T16:03:17.178742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":242,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180724+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:18.180724+0000","last_peered":"2024-06-11T16:03:18.180724+0000","last_clean":"2024-06-11T16:03:18.180724+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:18.180724+0000","last_undegraded":"2024-06-11T16:03:18.180724+0000","last_fullsized":"2024-06-11T16:03:18.180724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":374,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.688057+0000","last_change":"2024-06-11T16:03:17.688201+0000","last_active":"2024-06-11T16:03:17.688057+0000","last_peered":"2024-06-11T16:03:17.688057+0000","last_clean":"2024-06-11T16:00:49.274163+0000","last_became_active":"2024-06-11T16:03:16.190933+0000","last_became_peered":"2024-06-11T16:03:16.190933+0000","last_unstale":"2024-06-11T16:03:17.688057+0000","last_undegraded":"2024-06-11T16:03:17.688057+0000","last_fullsized":"2024-06-11T16:03:16.164984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179312+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:17.179312+0000","last_peered":"2024-06-11T16:03:17.179312+0000","last_clean":"2024-06-11T16:03:17.179312+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:17.179312+0000","last_undegraded":"2024-06-11T16:03:17.179312+0000","last_fullsized":"2024-06-11T16:03:17.179312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":273,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179296+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:18.179296+0000","last_peered":"2024-06-11T16:03:18.179296+0000","last_clean":"2024-06-11T16:03:18.179296+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:18.179296+0000","last_undegraded":"2024-06-11T16:03:18.179296+0000","last_fullsized":"2024-06-11T16:03:18.179296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184216+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:18.184216+0000","last_peered":"2024-06-11T16:03:18.184216+0000","last_clean":"2024-06-11T16:03:18.184216+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:18.184216+0000","last_undegraded":"2024-06-11T16:03:18.184216+0000","last_fullsized":"2024-06-11T16:03:18.184216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179647+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:18.179647+0000","last_peered":"2024-06-11T16:03:18.179647+0000","last_clean":"2024-06-11T16:03:18.179647+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:18.179647+0000","last_undegraded":"2024-06-11T16:03:18.179647+0000","last_fullsized":"2024-06-11T16:03:18.179647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":306,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181195+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:17.181195+0000","last_peered":"2024-06-11T16:03:17.181195+0000","last_clean":"2024-06-11T16:03:17.181195+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:17.181195+0000","last_undegraded":"2024-06-11T16:03:17.181195+0000","last_fullsized":"2024-06-11T16:03:17.181195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178840+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:17.178840+0000","last_peered":"2024-06-11T16:03:17.178840+0000","last_clean":"2024-06-11T16:03:17.178840+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:17.178840+0000","last_undegraded":"2024-06-11T16:03:17.178840+0000","last_fullsized":"2024-06-11T16:03:17.178840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180231+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:17.180231+0000","last_peered":"2024-06-11T16:03:17.180231+0000","last_clean":"2024-06-11T16:03:17.180231+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:17.180231+0000","last_undegraded":"2024-06-11T16:03:17.180231+0000","last_fullsized":"2024-06-11T16:03:17.180231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179717+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:18.179717+0000","last_peered":"2024-06-11T16:03:18.179717+0000","last_clean":"2024-06-11T16:03:18.179717+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:18.179717+0000","last_undegraded":"2024-06-11T16:03:18.179717+0000","last_fullsized":"2024-06-11T16:03:18.179717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":260,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.197243+0000","last_change":"2024-06-11T16:03:19.078723+0000","last_active":"2024-06-11T16:03:19.078723+0000","last_peered":"2024-06-11T16:03:17.197243+0000","last_clean":"2024-06-11T16:03:13.145303+0000","last_became_active":"2024-06-11T16:03:16.182774+0000","last_became_peered":"2024-06-11T16:03:16.182774+0000","last_unstale":"2024-06-11T16:03:17.197243+0000","last_undegraded":"2024-06-11T16:03:17.197243+0000","last_fullsized":"2024-06-11T16:03:16.158479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":215,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178382+0000","last_change":"2024-06-11T16:03:16.192703+0000","last_active":"2024-06-11T16:03:17.178382+0000","last_peered":"2024-06-11T16:03:17.178382+0000","last_clean":"2024-06-11T16:00:49.984702+0000","last_became_active":"2024-06-11T16:03:16.191902+0000","last_became_peered":"2024-06-11T16:03:16.191902+0000","last_unstale":"2024-06-11T16:03:17.178382+0000","last_undegraded":"2024-06-11T16:03:16.173719+0000","last_fullsized":"2024-06-11T16:03:16.162453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":107,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":61}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":521,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.579274+0000","last_change":"2024-06-11T16:03:17.579430+0000","last_active":"2024-06-11T16:03:17.579274+0000","last_peered":"2024-06-11T16:03:17.579274+0000","last_clean":"2024-06-11T16:03:13.142079+0000","last_became_active":"2024-06-11T16:03:16.185012+0000","last_became_peered":"2024-06-11T16:03:16.185012+0000","last_unstale":"2024-06-11T16:03:17.579274+0000","last_undegraded":"2024-06-11T16:03:17.579274+0000","last_fullsized":"2024-06-11T16:03:16.164051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":260,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177689+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:17.177689+0000","last_peered":"2024-06-11T16:03:17.177689+0000","last_clean":"2024-06-11T16:03:17.177689+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:17.177689+0000","last_undegraded":"2024-06-11T16:03:17.177689+0000","last_fullsized":"2024-06-11T16:03:17.177689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":412,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.501972+0000","last_change":"2024-06-11T16:03:17.179185+0000","last_active":"2024-06-11T16:03:17.179185+0000","last_peered":"2024-06-11T16:03:16.501972+0000","last_clean":"2024-06-11T16:00:48.876123+0000","last_became_active":"2024-06-11T16:03:16.189506+0000","last_became_peered":"2024-06-11T16:03:16.189506+0000","last_unstale":"2024-06-11T16:03:16.501972+0000","last_undegraded":"2024-06-11T16:03:16.501972+0000","last_fullsized":"2024-06-11T16:03:16.161578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":350,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180978+0000","last_change":"2024-06-11T16:03:16.189203+0000","last_active":"2024-06-11T16:03:17.180978+0000","last_peered":"2024-06-11T16:03:17.180978+0000","last_clean":"2024-06-11T16:03:13.145775+0000","last_became_active":"2024-06-11T16:03:16.188275+0000","last_became_peered":"2024-06-11T16:03:16.188275+0000","last_unstale":"2024-06-11T16:03:17.180978+0000","last_undegraded":"2024-06-11T16:03:16.167633+0000","last_fullsized":"2024-06-11T16:03:16.165841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":211,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180349+0000","last_change":"2024-06-11T16:03:16.195303+0000","last_active":"2024-06-11T16:03:17.180349+0000","last_peered":"2024-06-11T16:03:17.180349+0000","last_clean":"2024-06-11T16:00:51.884795+0000","last_became_active":"2024-06-11T16:03:16.194759+0000","last_became_peered":"2024-06-11T16:03:16.194759+0000","last_unstale":"2024-06-11T16:03:17.180349+0000","last_undegraded":"2024-06-11T16:03:16.179951+0000","last_fullsized":"2024-06-11T16:03:16.178957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178832+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:17.178832+0000","last_peered":"2024-06-11T16:03:17.178832+0000","last_clean":"2024-06-11T16:03:17.178832+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:17.178832+0000","last_undegraded":"2024-06-11T16:03:17.178832+0000","last_fullsized":"2024-06-11T16:03:17.178832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179463+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:17.179463+0000","last_peered":"2024-06-11T16:03:17.179463+0000","last_clean":"2024-06-11T16:03:17.179463+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:17.179463+0000","last_undegraded":"2024-06-11T16:03:17.179463+0000","last_fullsized":"2024-06-11T16:03:17.179463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":235,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180275+0000","last_change":"2024-06-11T16:03:16.194106+0000","last_active":"2024-06-11T16:03:17.180275+0000","last_peered":"2024-06-11T16:03:17.180275+0000","last_clean":"2024-06-11T16:00:49.278755+0000","last_became_active":"2024-06-11T16:03:16.193259+0000","last_became_peered":"2024-06-11T16:03:16.193259+0000","last_unstale":"2024-06-11T16:03:17.180275+0000","last_undegraded":"2024-06-11T16:03:16.177585+0000","last_fullsized":"2024-06-11T16:03:16.175596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":67}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179882+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:17.179882+0000","last_peered":"2024-06-11T16:03:17.179882+0000","last_clean":"2024-06-11T16:03:17.179882+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:17.179882+0000","last_undegraded":"2024-06-11T16:03:17.179882+0000","last_fullsized":"2024-06-11T16:03:17.179882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184212+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:18.184212+0000","last_peered":"2024-06-11T16:03:18.184212+0000","last_clean":"2024-06-11T16:03:18.184212+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:18.184212+0000","last_undegraded":"2024-06-11T16:03:18.184212+0000","last_fullsized":"2024-06-11T16:03:18.184212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178619+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:17.178619+0000","last_peered":"2024-06-11T16:03:17.178619+0000","last_clean":"2024-06-11T16:03:17.178619+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:17.178619+0000","last_undegraded":"2024-06-11T16:03:17.178619+0000","last_fullsized":"2024-06-11T16:03:17.178619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178880+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:18.178880+0000","last_peered":"2024-06-11T16:03:18.178880+0000","last_clean":"2024-06-11T16:03:18.178880+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:18.178880+0000","last_undegraded":"2024-06-11T16:03:18.178880+0000","last_fullsized":"2024-06-11T16:03:18.178880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179781+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:17.179781+0000","last_peered":"2024-06-11T16:03:17.179781+0000","last_clean":"2024-06-11T16:03:17.179781+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:17.179781+0000","last_undegraded":"2024-06-11T16:03:17.179781+0000","last_fullsized":"2024-06-11T16:03:17.179781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180574+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:17.180574+0000","last_peered":"2024-06-11T16:03:17.180574+0000","last_clean":"2024-06-11T16:03:17.180574+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:17.180574+0000","last_undegraded":"2024-06-11T16:03:17.180574+0000","last_fullsized":"2024-06-11T16:03:17.180574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182098+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:17.182098+0000","last_peered":"2024-06-11T16:03:17.182098+0000","last_clean":"2024-06-11T16:03:17.182098+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:17.182098+0000","last_undegraded":"2024-06-11T16:03:17.182098+0000","last_fullsized":"2024-06-11T16:03:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179206+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:17.179206+0000","last_peered":"2024-06-11T16:03:17.179206+0000","last_clean":"2024-06-11T16:03:17.179206+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:17.179206+0000","last_undegraded":"2024-06-11T16:03:17.179206+0000","last_fullsized":"2024-06-11T16:03:17.179206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180961+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:17.180961+0000","last_peered":"2024-06-11T16:03:17.180961+0000","last_clean":"2024-06-11T16:03:17.180961+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:17.180961+0000","last_undegraded":"2024-06-11T16:03:17.180961+0000","last_fullsized":"2024-06-11T16:03:17.180961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179354+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:18.179354+0000","last_peered":"2024-06-11T16:03:18.179354+0000","last_clean":"2024-06-11T16:03:18.179354+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:18.179354+0000","last_undegraded":"2024-06-11T16:03:18.179354+0000","last_fullsized":"2024-06-11T16:03:18.179354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179114+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:18.179114+0000","last_peered":"2024-06-11T16:03:18.179114+0000","last_clean":"2024-06-11T16:03:18.179114+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:18.179114+0000","last_undegraded":"2024-06-11T16:03:18.179114+0000","last_fullsized":"2024-06-11T16:03:18.179114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177782+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:17.177782+0000","last_peered":"2024-06-11T16:03:17.177782+0000","last_clean":"2024-06-11T16:03:17.177782+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:17.177782+0000","last_undegraded":"2024-06-11T16:03:17.177782+0000","last_fullsized":"2024-06-11T16:03:17.177782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178957+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:17.178957+0000","last_peered":"2024-06-11T16:03:17.178957+0000","last_clean":"2024-06-11T16:03:17.178957+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:17.178957+0000","last_undegraded":"2024-06-11T16:03:17.178957+0000","last_fullsized":"2024-06-11T16:03:17.178957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":267,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178333+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:17.178333+0000","last_peered":"2024-06-11T16:03:17.178333+0000","last_clean":"2024-06-11T16:03:17.178333+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:17.178333+0000","last_undegraded":"2024-06-11T16:03:17.178333+0000","last_fullsized":"2024-06-11T16:03:17.178333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179955+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:18.179955+0000","last_peered":"2024-06-11T16:03:18.179955+0000","last_clean":"2024-06-11T16:03:18.179955+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:18.179955+0000","last_undegraded":"2024-06-11T16:03:18.179955+0000","last_fullsized":"2024-06-11T16:03:18.179955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":270,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.181198+0000","last_change":"2024-06-11T16:03:16.192499+0000","last_active":"2024-06-11T16:03:17.181198+0000","last_peered":"2024-06-11T16:03:17.181198+0000","last_clean":"2024-06-11T16:03:13.145765+0000","last_became_active":"2024-06-11T16:03:16.191847+0000","last_became_peered":"2024-06-11T16:03:16.191847+0000","last_unstale":"2024-06-11T16:03:17.181198+0000","last_undegraded":"2024-06-11T16:03:16.166138+0000","last_fullsized":"2024-06-11T16:03:16.164953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179537+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:18.179537+0000","last_peered":"2024-06-11T16:03:18.179537+0000","last_clean":"2024-06-11T16:03:18.179537+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:18.179537+0000","last_undegraded":"2024-06-11T16:03:18.179537+0000","last_fullsized":"2024-06-11T16:03:18.179537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":317,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179491+0000","last_change":"2024-06-11T16:03:16.191512+0000","last_active":"2024-06-11T16:03:17.179491+0000","last_peered":"2024-06-11T16:03:17.179491+0000","last_clean":"2024-06-11T16:03:13.144603+0000","last_became_active":"2024-06-11T16:03:16.190589+0000","last_became_peered":"2024-06-11T16:03:16.190589+0000","last_unstale":"2024-06-11T16:03:17.179491+0000","last_undegraded":"2024-06-11T16:03:16.168532+0000","last_fullsized":"2024-06-11T16:03:16.166580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179803+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:17.179803+0000","last_peered":"2024-06-11T16:03:17.179803+0000","last_clean":"2024-06-11T16:03:17.179803+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:17.179803+0000","last_undegraded":"2024-06-11T16:03:17.179803+0000","last_fullsized":"2024-06-11T16:03:17.179803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":281,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179286+0000","last_change":"2024-06-11T16:03:16.188586+0000","last_active":"2024-06-11T16:03:17.179286+0000","last_peered":"2024-06-11T16:03:17.179286+0000","last_clean":"2024-06-11T16:03:13.144491+0000","last_became_active":"2024-06-11T16:03:16.187988+0000","last_became_peered":"2024-06-11T16:03:16.187988+0000","last_unstale":"2024-06-11T16:03:17.179286+0000","last_undegraded":"2024-06-11T16:03:16.165185+0000","last_fullsized":"2024-06-11T16:03:16.159943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178823+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:18.178823+0000","last_peered":"2024-06-11T16:03:18.178823+0000","last_clean":"2024-06-11T16:03:18.178823+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:18.178823+0000","last_undegraded":"2024-06-11T16:03:18.178823+0000","last_fullsized":"2024-06-11T16:03:18.178823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":267,"reported_epoch":84,"state":"active+recovering+undersized+remapped","last_fresh":"2024-06-11T16:03:18.128201+0000","last_change":"2024-06-11T16:03:18.071702+0000","last_active":"2024-06-11T16:03:18.128201+0000","last_peered":"2024-06-11T16:03:18.128201+0000","last_clean":"2024-06-11T16:00:54.881776+0000","last_became_active":"2024-06-11T16:03:16.191861+0000","last_became_peered":"2024-06-11T16:03:16.191861+0000","last_unstale":"2024-06-11T16:03:18.128201+0000","last_undegraded":"2024-06-11T16:03:18.128201+0000","last_fullsized":"2024-06-11T16:03:16.175219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":25864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":34},{"shards":"1","objects":24}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179338+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:17.179338+0000","last_peered":"2024-06-11T16:03:17.179338+0000","last_clean":"2024-06-11T16:03:17.179338+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:17.179338+0000","last_undegraded":"2024-06-11T16:03:17.179338+0000","last_fullsized":"2024-06-11T16:03:17.179338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":224,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.440008+0000","last_change":"2024-06-11T16:03:19.078787+0000","last_active":"2024-06-11T16:03:19.078787+0000","last_peered":"2024-06-11T16:03:17.440008+0000","last_clean":"2024-06-11T16:03:12.135478+0000","last_became_active":"2024-06-11T16:03:16.184920+0000","last_became_peered":"2024-06-11T16:03:16.184920+0000","last_unstale":"2024-06-11T16:03:17.440008+0000","last_undegraded":"2024-06-11T16:03:17.440008+0000","last_fullsized":"2024-06-11T16:03:17.440008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178361+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:17.178361+0000","last_peered":"2024-06-11T16:03:17.178361+0000","last_clean":"2024-06-11T16:03:17.178361+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:17.178361+0000","last_undegraded":"2024-06-11T16:03:17.178361+0000","last_fullsized":"2024-06-11T16:03:17.178361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180989+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:17.180989+0000","last_peered":"2024-06-11T16:03:17.180989+0000","last_clean":"2024-06-11T16:03:17.180989+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:17.180989+0000","last_undegraded":"2024-06-11T16:03:17.180989+0000","last_fullsized":"2024-06-11T16:03:17.180989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":239,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.443714+0000","last_change":"2024-06-11T16:03:19.078630+0000","last_active":"2024-06-11T16:03:19.078630+0000","last_peered":"2024-06-11T16:03:17.443714+0000","last_clean":"2024-06-11T15:58:53.120953+0000","last_became_active":"2024-06-11T16:03:16.191135+0000","last_became_peered":"2024-06-11T16:03:16.191135+0000","last_unstale":"2024-06-11T16:03:17.443714+0000","last_undegraded":"2024-06-11T16:03:17.443714+0000","last_fullsized":"2024-06-11T16:03:16.164894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178783+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:18.178783+0000","last_peered":"2024-06-11T16:03:18.178783+0000","last_clean":"2024-06-11T16:03:18.178783+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:18.178783+0000","last_undegraded":"2024-06-11T16:03:18.178783+0000","last_fullsized":"2024-06-11T16:03:18.178783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":170,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181497+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:17.181497+0000","last_peered":"2024-06-11T16:03:17.181497+0000","last_clean":"2024-06-11T16:03:17.181497+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:17.181497+0000","last_undegraded":"2024-06-11T16:03:17.181497+0000","last_fullsized":"2024-06-11T16:03:17.181497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":202,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.948980+0000","last_change":"2024-06-11T16:03:19.078773+0000","last_active":"2024-06-11T16:03:19.078773+0000","last_peered":"2024-06-11T16:03:17.948980+0000","last_clean":"2024-06-11T16:00:54.882186+0000","last_became_active":"2024-06-11T16:03:16.191785+0000","last_became_peered":"2024-06-11T16:03:16.191785+0000","last_unstale":"2024-06-11T16:03:17.948980+0000","last_undegraded":"2024-06-11T16:03:17.948980+0000","last_fullsized":"2024-06-11T16:03:16.162689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179560+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:18.179560+0000","last_peered":"2024-06-11T16:03:18.179560+0000","last_clean":"2024-06-11T16:03:18.179560+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:18.179560+0000","last_undegraded":"2024-06-11T16:03:18.179560+0000","last_fullsized":"2024-06-11T16:03:18.179560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":236,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180143+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:17.180143+0000","last_peered":"2024-06-11T16:03:17.180143+0000","last_clean":"2024-06-11T16:03:17.180143+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:17.180143+0000","last_undegraded":"2024-06-11T16:03:17.180143+0000","last_fullsized":"2024-06-11T16:03:17.180143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178783+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:17.178783+0000","last_peered":"2024-06-11T16:03:17.178783+0000","last_clean":"2024-06-11T16:03:17.178783+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:17.178783+0000","last_undegraded":"2024-06-11T16:03:17.178783+0000","last_fullsized":"2024-06-11T16:03:17.178783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180383+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:17.180383+0000","last_peered":"2024-06-11T16:03:17.180383+0000","last_clean":"2024-06-11T16:03:17.180383+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:17.180383+0000","last_undegraded":"2024-06-11T16:03:17.180383+0000","last_fullsized":"2024-06-11T16:03:17.180383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178212+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:17.178212+0000","last_peered":"2024-06-11T16:03:17.178212+0000","last_clean":"2024-06-11T16:03:17.178212+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:17.178212+0000","last_undegraded":"2024-06-11T16:03:17.178212+0000","last_fullsized":"2024-06-11T16:03:17.178212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181052+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:17.181052+0000","last_peered":"2024-06-11T16:03:17.181052+0000","last_clean":"2024-06-11T16:03:17.181052+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:17.181052+0000","last_undegraded":"2024-06-11T16:03:17.181052+0000","last_fullsized":"2024-06-11T16:03:17.181052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178739+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:18.178739+0000","last_peered":"2024-06-11T16:03:18.178739+0000","last_clean":"2024-06-11T16:03:18.178739+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:18.178739+0000","last_undegraded":"2024-06-11T16:03:18.178739+0000","last_fullsized":"2024-06-11T16:03:18.178739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178519+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:18.178519+0000","last_peered":"2024-06-11T16:03:18.178519+0000","last_clean":"2024-06-11T16:03:18.178519+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:18.178519+0000","last_undegraded":"2024-06-11T16:03:18.178519+0000","last_fullsized":"2024-06-11T16:03:18.178519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180246+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:17.180246+0000","last_peered":"2024-06-11T16:03:17.180246+0000","last_clean":"2024-06-11T16:03:17.180246+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:17.180246+0000","last_undegraded":"2024-06-11T16:03:17.180246+0000","last_fullsized":"2024-06-11T16:03:17.180246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180209+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:18.180209+0000","last_peered":"2024-06-11T16:03:18.180209+0000","last_clean":"2024-06-11T16:03:18.180209+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:18.180209+0000","last_undegraded":"2024-06-11T16:03:18.180209+0000","last_fullsized":"2024-06-11T16:03:18.180209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180464+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:17.180464+0000","last_peered":"2024-06-11T16:03:17.180464+0000","last_clean":"2024-06-11T16:03:17.180464+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:17.180464+0000","last_undegraded":"2024-06-11T16:03:17.180464+0000","last_fullsized":"2024-06-11T16:03:17.180464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":209,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179690+0000","last_change":"2024-06-11T16:03:16.193053+0000","last_active":"2024-06-11T16:03:17.179690+0000","last_peered":"2024-06-11T16:03:17.179690+0000","last_clean":"2024-06-11T16:00:49.275319+0000","last_became_active":"2024-06-11T16:03:16.192031+0000","last_became_peered":"2024-06-11T16:03:16.192031+0000","last_unstale":"2024-06-11T16:03:17.179690+0000","last_undegraded":"2024-06-11T16:03:16.177017+0000","last_fullsized":"2024-06-11T16:03:16.175201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":40}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180359+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:17.180359+0000","last_peered":"2024-06-11T16:03:17.180359+0000","last_clean":"2024-06-11T16:03:17.180359+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:17.180359+0000","last_undegraded":"2024-06-11T16:03:17.180359+0000","last_fullsized":"2024-06-11T16:03:17.180359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180454+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:17.180454+0000","last_peered":"2024-06-11T16:03:17.180454+0000","last_clean":"2024-06-11T16:03:17.180454+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:17.180454+0000","last_undegraded":"2024-06-11T16:03:17.180454+0000","last_fullsized":"2024-06-11T16:03:17.180454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":232,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179384+0000","last_change":"2024-06-11T16:03:16.193264+0000","last_active":"2024-06-11T16:03:17.179384+0000","last_peered":"2024-06-11T16:03:17.179384+0000","last_clean":"2024-06-11T16:00:51.883199+0000","last_became_active":"2024-06-11T16:03:16.192397+0000","last_became_peered":"2024-06-11T16:03:16.192397+0000","last_unstale":"2024-06-11T16:03:17.179384+0000","last_undegraded":"2024-06-11T16:03:16.178925+0000","last_fullsized":"2024-06-11T16:03:16.176807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181264+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:17.181264+0000","last_peered":"2024-06-11T16:03:17.181264+0000","last_clean":"2024-06-11T16:03:17.181264+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:17.181264+0000","last_undegraded":"2024-06-11T16:03:17.181264+0000","last_fullsized":"2024-06-11T16:03:17.181264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182211+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:17.182211+0000","last_peered":"2024-06-11T16:03:17.182211+0000","last_clean":"2024-06-11T16:03:17.182211+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:17.182211+0000","last_undegraded":"2024-06-11T16:03:17.182211+0000","last_fullsized":"2024-06-11T16:03:17.182211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":300,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180679+0000","last_change":"2024-06-11T16:03:16.190115+0000","last_active":"2024-06-11T16:03:17.180679+0000","last_peered":"2024-06-11T16:03:17.180679+0000","last_clean":"2024-06-11T16:03:13.144927+0000","last_became_active":"2024-06-11T16:03:16.189305+0000","last_became_peered":"2024-06-11T16:03:16.189305+0000","last_unstale":"2024-06-11T16:03:17.180679+0000","last_undegraded":"2024-06-11T16:03:16.167879+0000","last_fullsized":"2024-06-11T16:03:16.164999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":202,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182140+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:17.182140+0000","last_peered":"2024-06-11T16:03:17.182140+0000","last_clean":"2024-06-11T16:03:17.182140+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:17.182140+0000","last_undegraded":"2024-06-11T16:03:17.182140+0000","last_fullsized":"2024-06-11T16:03:17.182140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179070+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:18.179070+0000","last_peered":"2024-06-11T16:03:18.179070+0000","last_clean":"2024-06-11T16:03:18.179070+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:18.179070+0000","last_undegraded":"2024-06-11T16:03:18.179070+0000","last_fullsized":"2024-06-11T16:03:18.179070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":380,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.776931+0000","last_change":"2024-06-11T16:03:17.179022+0000","last_active":"2024-06-11T16:03:17.179022+0000","last_peered":"2024-06-11T16:03:16.776931+0000","last_clean":"2024-06-11T16:00:51.883048+0000","last_became_active":"2024-06-11T16:03:16.190080+0000","last_became_peered":"2024-06-11T16:03:16.190080+0000","last_unstale":"2024-06-11T16:03:16.776931+0000","last_undegraded":"2024-06-11T16:03:16.776931+0000","last_fullsized":"2024-06-11T16:03:16.162599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":203,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178020+0000","last_change":"2024-06-11T16:03:16.193145+0000","last_active":"2024-06-11T16:03:17.178020+0000","last_peered":"2024-06-11T16:03:17.178020+0000","last_clean":"2024-06-11T16:00:49.663987+0000","last_became_active":"2024-06-11T16:03:16.192482+0000","last_became_peered":"2024-06-11T16:03:16.192482+0000","last_unstale":"2024-06-11T16:03:17.178020+0000","last_undegraded":"2024-06-11T16:03:16.179441+0000","last_fullsized":"2024-06-11T16:03:16.178454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179630+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:18.179630+0000","last_peered":"2024-06-11T16:03:18.179630+0000","last_clean":"2024-06-11T16:03:18.179630+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:18.179630+0000","last_undegraded":"2024-06-11T16:03:18.179630+0000","last_fullsized":"2024-06-11T16:03:18.179630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":288,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180302+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:17.180302+0000","last_peered":"2024-06-11T16:03:17.180302+0000","last_clean":"2024-06-11T16:03:17.180302+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:17.180302+0000","last_undegraded":"2024-06-11T16:03:17.180302+0000","last_fullsized":"2024-06-11T16:03:17.180302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180229+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:17.180229+0000","last_peered":"2024-06-11T16:03:17.180229+0000","last_clean":"2024-06-11T16:03:17.180229+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:17.180229+0000","last_undegraded":"2024-06-11T16:03:17.180229+0000","last_fullsized":"2024-06-11T16:03:17.180229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178653+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:18.178653+0000","last_peered":"2024-06-11T16:03:18.178653+0000","last_clean":"2024-06-11T16:03:18.178653+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:18.178653+0000","last_undegraded":"2024-06-11T16:03:18.178653+0000","last_fullsized":"2024-06-11T16:03:18.178653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":328,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179969+0000","last_change":"2024-06-11T16:03:16.187720+0000","last_active":"2024-06-11T16:03:17.179969+0000","last_peered":"2024-06-11T16:03:17.179969+0000","last_clean":"2024-06-11T16:03:13.142425+0000","last_became_active":"2024-06-11T16:03:16.186853+0000","last_became_peered":"2024-06-11T16:03:16.186853+0000","last_unstale":"2024-06-11T16:03:17.179969+0000","last_undegraded":"2024-06-11T16:03:16.166457+0000","last_fullsized":"2024-06-11T16:03:16.164143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181175+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:17.181175+0000","last_peered":"2024-06-11T16:03:17.181175+0000","last_clean":"2024-06-11T16:03:17.181175+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:17.181175+0000","last_undegraded":"2024-06-11T16:03:17.181175+0000","last_fullsized":"2024-06-11T16:03:17.181175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180557+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:17.180557+0000","last_peered":"2024-06-11T16:03:17.180557+0000","last_clean":"2024-06-11T16:03:17.180557+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:17.180557+0000","last_undegraded":"2024-06-11T16:03:17.180557+0000","last_fullsized":"2024-06-11T16:03:17.180557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179402+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:17.179402+0000","last_peered":"2024-06-11T16:03:17.179402+0000","last_clean":"2024-06-11T16:03:17.179402+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:17.179402+0000","last_undegraded":"2024-06-11T16:03:17.179402+0000","last_fullsized":"2024-06-11T16:03:17.179402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181449+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:17.181449+0000","last_peered":"2024-06-11T16:03:17.181449+0000","last_clean":"2024-06-11T16:03:17.181449+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:17.181449+0000","last_undegraded":"2024-06-11T16:03:17.181449+0000","last_fullsized":"2024-06-11T16:03:17.181449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":506,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.822590+0000","last_change":"2024-06-11T16:03:17.822806+0000","last_active":"2024-06-11T16:03:17.822590+0000","last_peered":"2024-06-11T16:03:17.822590+0000","last_clean":"2024-06-11T16:03:13.147288+0000","last_became_active":"2024-06-11T16:03:16.186444+0000","last_became_peered":"2024-06-11T16:03:16.186444+0000","last_unstale":"2024-06-11T16:03:17.822590+0000","last_undegraded":"2024-06-11T16:03:17.822590+0000","last_fullsized":"2024-06-11T16:03:16.166311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":47}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180053+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:17.180053+0000","last_peered":"2024-06-11T16:03:17.180053+0000","last_clean":"2024-06-11T16:03:17.180053+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:17.180053+0000","last_undegraded":"2024-06-11T16:03:17.180053+0000","last_fullsized":"2024-06-11T16:03:17.180053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":198,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179432+0000","last_change":"2024-06-11T16:03:16.193737+0000","last_active":"2024-06-11T16:03:17.179432+0000","last_peered":"2024-06-11T16:03:17.179432+0000","last_clean":"2024-06-11T16:00:49.783464+0000","last_became_active":"2024-06-11T16:03:16.193263+0000","last_became_peered":"2024-06-11T16:03:16.193263+0000","last_unstale":"2024-06-11T16:03:17.179432+0000","last_undegraded":"2024-06-11T16:03:16.176440+0000","last_fullsized":"2024-06-11T16:03:16.175378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180299+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:17.180299+0000","last_peered":"2024-06-11T16:03:17.180299+0000","last_clean":"2024-06-11T16:03:17.180299+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:17.180299+0000","last_undegraded":"2024-06-11T16:03:17.180299+0000","last_fullsized":"2024-06-11T16:03:17.180299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178537+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:17.178537+0000","last_peered":"2024-06-11T16:03:17.178537+0000","last_clean":"2024-06-11T16:03:17.178537+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:17.178537+0000","last_undegraded":"2024-06-11T16:03:17.178537+0000","last_fullsized":"2024-06-11T16:03:17.178537+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179505+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:17.179505+0000","last_peered":"2024-06-11T16:03:17.179505+0000","last_clean":"2024-06-11T16:03:17.179505+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:17.179505+0000","last_undegraded":"2024-06-11T16:03:17.179505+0000","last_fullsized":"2024-06-11T16:03:17.179505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":269,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179186+0000","last_change":"2024-06-11T16:03:16.191650+0000","last_active":"2024-06-11T16:03:17.179186+0000","last_peered":"2024-06-11T16:03:17.179186+0000","last_clean":"2024-06-11T16:03:13.142283+0000","last_became_active":"2024-06-11T16:03:16.190729+0000","last_became_peered":"2024-06-11T16:03:16.190729+0000","last_unstale":"2024-06-11T16:03:17.179186+0000","last_undegraded":"2024-06-11T16:03:16.166117+0000","last_fullsized":"2024-06-11T16:03:16.164379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179592+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:18.179592+0000","last_peered":"2024-06-11T16:03:18.179592+0000","last_clean":"2024-06-11T16:03:18.179592+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:18.179592+0000","last_undegraded":"2024-06-11T16:03:18.179592+0000","last_fullsized":"2024-06-11T16:03:18.179592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":267,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180520+0000","last_change":"2024-06-11T16:03:16.192319+0000","last_active":"2024-06-11T16:03:17.180520+0000","last_peered":"2024-06-11T16:03:17.180520+0000","last_clean":"2024-06-11T16:03:13.145653+0000","last_became_active":"2024-06-11T16:03:16.191660+0000","last_became_peered":"2024-06-11T16:03:16.191660+0000","last_unstale":"2024-06-11T16:03:17.180520+0000","last_undegraded":"2024-06-11T16:03:16.167404+0000","last_fullsized":"2024-06-11T16:03:16.164859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180133+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:17.180133+0000","last_peered":"2024-06-11T16:03:17.180133+0000","last_clean":"2024-06-11T16:03:17.180133+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:17.180133+0000","last_undegraded":"2024-06-11T16:03:17.180133+0000","last_fullsized":"2024-06-11T16:03:17.180133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":262,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179399+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:17.179399+0000","last_peered":"2024-06-11T16:03:17.179399+0000","last_clean":"2024-06-11T16:03:17.179399+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:17.179399+0000","last_undegraded":"2024-06-11T16:03:17.179399+0000","last_fullsized":"2024-06-11T16:03:17.179399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181607+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:17.181607+0000","last_peered":"2024-06-11T16:03:17.181607+0000","last_clean":"2024-06-11T16:03:17.181607+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:17.181607+0000","last_undegraded":"2024-06-11T16:03:17.181607+0000","last_fullsized":"2024-06-11T16:03:17.181607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":297,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179603+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:18.179603+0000","last_peered":"2024-06-11T16:03:18.179603+0000","last_clean":"2024-06-11T16:03:18.179603+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:18.179603+0000","last_undegraded":"2024-06-11T16:03:18.179603+0000","last_fullsized":"2024-06-11T16:03:18.179603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181083+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:17.181083+0000","last_peered":"2024-06-11T16:03:17.181083+0000","last_clean":"2024-06-11T16:03:17.181083+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:17.181083+0000","last_undegraded":"2024-06-11T16:03:17.181083+0000","last_fullsized":"2024-06-11T16:03:17.181083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2171,"num_bytes_recovered":8609565,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74182656,"data_stored":61283340,"data_compressed":5274910,"data_compressed_allocated":6189056,"data_compressed_original":16252928,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":84874432,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49760,"kb_used_data":22224,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94322080,"statfs":{"total":96636764160,"available":96585809920,"internally_reserved":0,"allocated":22757376,"data_stored":48965737,"data_compressed":5999773,"data_compressed_allocated":7065600,"data_compressed_original":37867520,"omap_allocated":7164,"internal_metadata":28173316},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89456,"kb_used_data":31900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94282384,"statfs":{"total":96636764160,"available":96545161216,"internally_reserved":0,"allocated":32665600,"data_stored":51358741,"data_compressed":6440081,"data_compressed_allocated":7618560,"data_compressed_original":35721216,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93104,"kb_used_data":35552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278736,"statfs":{"total":96636764160,"available":96541425664,"internally_reserved":0,"allocated":36405248,"data_stored":48372234,"data_compressed":5307051,"data_compressed_allocated":6299648,"data_compressed_original":28110848,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":21464877,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31338496,"data_stored":25976002,"data_compressed":2198540,"data_compressed_allocated":2572288,"data_compressed_original":6660096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26144768,"data_stored":20903296,"data_compressed":2015679,"data_compressed_allocated":2363392,"data_compressed_original":6131712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16699392,"data_stored":14404042,"data_compressed":1060691,"data_compressed_allocated":1253376,"data_compressed_original":3461120,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:19.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-11T16:03:20.045 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:20.045 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 15 pgs peering","count":15},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":279,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":3,"num_up_osds":3,"osd_up_since":1718121780,"num_in_osds":3,"osd_in_since":1718121520,"num_remapped_pgs":13},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":61},{"state_name":"remapped+peering","count":32},{"state_name":"peering","count":12}],"num_pgs":105,"num_pools":4,"num_objects":3484,"data_bytes":69803379,"bytes_used":237203456,"bytes_avail":289673089024,"bytes_total":289910292480,"inactive_pgs_ratio":0.41904762387275696,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":6373051,"recovering_keys_per_sec":0,"num_objects_recovered":12,"num_bytes_recovered":25495969,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4201}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-11T16:00:01.587769+0000","services":{}},"progress_events":{}} 2024-06-11T16:03:20.058 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-06-11T16:03:20.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:20.353 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:20.354 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:20.364 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-06-11T16:03:20.137509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2208,"num_bytes_recovered":39475596,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":190,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":232320,"kb_used_data":89676,"kb_used_omap":10,"kb_used_meta":142581,"kb_avail":282883200,"statfs":{"total":289910292480,"available":289672396800,"internally_reserved":0,"allocated":91828224,"data_stored":148696712,"data_compressed":17746905,"data_compressed_allocated":20983808,"data_compressed_original":101699584,"omap_allocated":10353,"internal_metadata":146003855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-6,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1110,"num_bytes_recovered":-1328971,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.980408"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179194+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:17.179194+0000","last_peered":"2024-06-11T16:03:17.179194+0000","last_clean":"2024-06-11T16:03:17.179194+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:17.179194+0000","last_undegraded":"2024-06-11T16:03:17.179194+0000","last_fullsized":"2024-06-11T16:03:17.179194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178683+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:17.178683+0000","last_peered":"2024-06-11T16:03:17.178683+0000","last_clean":"2024-06-11T16:03:17.178683+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:17.178683+0000","last_undegraded":"2024-06-11T16:03:17.178683+0000","last_fullsized":"2024-06-11T16:03:17.178683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":236,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.320321+0000","last_change":"2024-06-11T16:03:19.078765+0000","last_active":"2024-06-11T16:03:19.078765+0000","last_peered":"2024-06-11T16:03:17.320321+0000","last_clean":"2024-06-11T16:00:50.272256+0000","last_became_active":"2024-06-11T16:03:16.189967+0000","last_became_peered":"2024-06-11T16:03:16.189967+0000","last_unstale":"2024-06-11T16:03:17.320321+0000","last_undegraded":"2024-06-11T16:03:17.320321+0000","last_fullsized":"2024-06-11T16:03:16.159979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":231,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:18.069662+0000","last_change":"2024-06-11T16:03:19.078732+0000","last_active":"2024-06-11T16:03:19.078732+0000","last_peered":"2024-06-11T16:03:18.069662+0000","last_clean":"2024-06-11T16:03:13.145938+0000","last_became_active":"2024-06-11T16:03:16.186231+0000","last_became_peered":"2024-06-11T16:03:16.186231+0000","last_unstale":"2024-06-11T16:03:18.069662+0000","last_undegraded":"2024-06-11T16:03:18.069662+0000","last_fullsized":"2024-06-11T16:03:16.160424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":277,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179405+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:17.179405+0000","last_peered":"2024-06-11T16:03:17.179405+0000","last_clean":"2024-06-11T16:03:17.179405+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:17.179405+0000","last_undegraded":"2024-06-11T16:03:17.179405+0000","last_fullsized":"2024-06-11T16:03:17.179405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183982+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:18.183982+0000","last_peered":"2024-06-11T16:03:18.183982+0000","last_clean":"2024-06-11T16:03:18.183982+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:18.183982+0000","last_undegraded":"2024-06-11T16:03:18.183982+0000","last_fullsized":"2024-06-11T16:03:18.183982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183991+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:18.183991+0000","last_peered":"2024-06-11T16:03:18.183991+0000","last_clean":"2024-06-11T16:03:18.183991+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:18.183991+0000","last_undegraded":"2024-06-11T16:03:18.183991+0000","last_fullsized":"2024-06-11T16:03:18.183991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":238,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180398+0000","last_change":"2024-06-11T16:03:16.189003+0000","last_active":"2024-06-11T16:03:17.180398+0000","last_peered":"2024-06-11T16:03:17.180398+0000","last_clean":"2024-06-11T16:03:13.142708+0000","last_became_active":"2024-06-11T16:03:16.188468+0000","last_became_peered":"2024-06-11T16:03:16.188468+0000","last_unstale":"2024-06-11T16:03:17.180398+0000","last_undegraded":"2024-06-11T16:03:16.162443+0000","last_fullsized":"2024-06-11T16:03:16.160406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":313,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180669+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:17.180669+0000","last_peered":"2024-06-11T16:03:17.180669+0000","last_clean":"2024-06-11T16:03:17.180669+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:17.180669+0000","last_undegraded":"2024-06-11T16:03:17.180669+0000","last_fullsized":"2024-06-11T16:03:17.180669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":226,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178742+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:17.178742+0000","last_peered":"2024-06-11T16:03:17.178742+0000","last_clean":"2024-06-11T16:03:17.178742+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:17.178742+0000","last_undegraded":"2024-06-11T16:03:17.178742+0000","last_fullsized":"2024-06-11T16:03:17.178742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":242,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180724+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:18.180724+0000","last_peered":"2024-06-11T16:03:18.180724+0000","last_clean":"2024-06-11T16:03:18.180724+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:18.180724+0000","last_undegraded":"2024-06-11T16:03:18.180724+0000","last_fullsized":"2024-06-11T16:03:18.180724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":374,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.688057+0000","last_change":"2024-06-11T16:03:17.688201+0000","last_active":"2024-06-11T16:03:17.688057+0000","last_peered":"2024-06-11T16:03:17.688057+0000","last_clean":"2024-06-11T16:00:49.274163+0000","last_became_active":"2024-06-11T16:03:16.190933+0000","last_became_peered":"2024-06-11T16:03:16.190933+0000","last_unstale":"2024-06-11T16:03:17.688057+0000","last_undegraded":"2024-06-11T16:03:17.688057+0000","last_fullsized":"2024-06-11T16:03:16.164984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":224,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179312+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:17.179312+0000","last_peered":"2024-06-11T16:03:17.179312+0000","last_clean":"2024-06-11T16:03:17.179312+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:17.179312+0000","last_undegraded":"2024-06-11T16:03:17.179312+0000","last_fullsized":"2024-06-11T16:03:17.179312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":273,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179296+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:18.179296+0000","last_peered":"2024-06-11T16:03:18.179296+0000","last_clean":"2024-06-11T16:03:18.179296+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:18.179296+0000","last_undegraded":"2024-06-11T16:03:18.179296+0000","last_fullsized":"2024-06-11T16:03:18.179296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184216+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:18.184216+0000","last_peered":"2024-06-11T16:03:18.184216+0000","last_clean":"2024-06-11T16:03:18.184216+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:18.184216+0000","last_undegraded":"2024-06-11T16:03:18.184216+0000","last_fullsized":"2024-06-11T16:03:18.184216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179647+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:18.179647+0000","last_peered":"2024-06-11T16:03:18.179647+0000","last_clean":"2024-06-11T16:03:18.179647+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:18.179647+0000","last_undegraded":"2024-06-11T16:03:18.179647+0000","last_fullsized":"2024-06-11T16:03:18.179647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":306,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181195+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:17.181195+0000","last_peered":"2024-06-11T16:03:17.181195+0000","last_clean":"2024-06-11T16:03:17.181195+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:17.181195+0000","last_undegraded":"2024-06-11T16:03:17.181195+0000","last_fullsized":"2024-06-11T16:03:17.181195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178840+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:17.178840+0000","last_peered":"2024-06-11T16:03:17.178840+0000","last_clean":"2024-06-11T16:03:17.178840+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:17.178840+0000","last_undegraded":"2024-06-11T16:03:17.178840+0000","last_fullsized":"2024-06-11T16:03:17.178840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":289,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180231+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:17.180231+0000","last_peered":"2024-06-11T16:03:17.180231+0000","last_clean":"2024-06-11T16:03:17.180231+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:17.180231+0000","last_undegraded":"2024-06-11T16:03:17.180231+0000","last_fullsized":"2024-06-11T16:03:17.180231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179717+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:18.179717+0000","last_peered":"2024-06-11T16:03:18.179717+0000","last_clean":"2024-06-11T16:03:18.179717+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:18.179717+0000","last_undegraded":"2024-06-11T16:03:18.179717+0000","last_fullsized":"2024-06-11T16:03:18.179717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":260,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.197243+0000","last_change":"2024-06-11T16:03:19.078723+0000","last_active":"2024-06-11T16:03:19.078723+0000","last_peered":"2024-06-11T16:03:17.197243+0000","last_clean":"2024-06-11T16:03:13.145303+0000","last_became_active":"2024-06-11T16:03:16.182774+0000","last_became_peered":"2024-06-11T16:03:16.182774+0000","last_unstale":"2024-06-11T16:03:17.197243+0000","last_undegraded":"2024-06-11T16:03:17.197243+0000","last_fullsized":"2024-06-11T16:03:16.158479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":215,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178382+0000","last_change":"2024-06-11T16:03:16.192703+0000","last_active":"2024-06-11T16:03:17.178382+0000","last_peered":"2024-06-11T16:03:17.178382+0000","last_clean":"2024-06-11T16:00:49.984702+0000","last_became_active":"2024-06-11T16:03:16.191902+0000","last_became_peered":"2024-06-11T16:03:16.191902+0000","last_unstale":"2024-06-11T16:03:17.178382+0000","last_undegraded":"2024-06-11T16:03:16.173719+0000","last_fullsized":"2024-06-11T16:03:16.162453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":107,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":61}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":521,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.579274+0000","last_change":"2024-06-11T16:03:17.579430+0000","last_active":"2024-06-11T16:03:17.579274+0000","last_peered":"2024-06-11T16:03:17.579274+0000","last_clean":"2024-06-11T16:03:13.142079+0000","last_became_active":"2024-06-11T16:03:16.185012+0000","last_became_peered":"2024-06-11T16:03:16.185012+0000","last_unstale":"2024-06-11T16:03:17.579274+0000","last_undegraded":"2024-06-11T16:03:17.579274+0000","last_fullsized":"2024-06-11T16:03:16.164051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":260,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177689+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:17.177689+0000","last_peered":"2024-06-11T16:03:17.177689+0000","last_clean":"2024-06-11T16:03:17.177689+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:17.177689+0000","last_undegraded":"2024-06-11T16:03:17.177689+0000","last_fullsized":"2024-06-11T16:03:17.177689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":412,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.501972+0000","last_change":"2024-06-11T16:03:17.179185+0000","last_active":"2024-06-11T16:03:17.179185+0000","last_peered":"2024-06-11T16:03:16.501972+0000","last_clean":"2024-06-11T16:00:48.876123+0000","last_became_active":"2024-06-11T16:03:16.189506+0000","last_became_peered":"2024-06-11T16:03:16.189506+0000","last_unstale":"2024-06-11T16:03:16.501972+0000","last_undegraded":"2024-06-11T16:03:16.501972+0000","last_fullsized":"2024-06-11T16:03:16.161578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":350,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180978+0000","last_change":"2024-06-11T16:03:16.189203+0000","last_active":"2024-06-11T16:03:17.180978+0000","last_peered":"2024-06-11T16:03:17.180978+0000","last_clean":"2024-06-11T16:03:13.145775+0000","last_became_active":"2024-06-11T16:03:16.188275+0000","last_became_peered":"2024-06-11T16:03:16.188275+0000","last_unstale":"2024-06-11T16:03:17.180978+0000","last_undegraded":"2024-06-11T16:03:16.167633+0000","last_fullsized":"2024-06-11T16:03:16.165841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":211,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180349+0000","last_change":"2024-06-11T16:03:16.195303+0000","last_active":"2024-06-11T16:03:17.180349+0000","last_peered":"2024-06-11T16:03:17.180349+0000","last_clean":"2024-06-11T16:00:51.884795+0000","last_became_active":"2024-06-11T16:03:16.194759+0000","last_became_peered":"2024-06-11T16:03:16.194759+0000","last_unstale":"2024-06-11T16:03:17.180349+0000","last_undegraded":"2024-06-11T16:03:16.179951+0000","last_fullsized":"2024-06-11T16:03:16.178957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178832+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:17.178832+0000","last_peered":"2024-06-11T16:03:17.178832+0000","last_clean":"2024-06-11T16:03:17.178832+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:17.178832+0000","last_undegraded":"2024-06-11T16:03:17.178832+0000","last_fullsized":"2024-06-11T16:03:17.178832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":310,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179463+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:17.179463+0000","last_peered":"2024-06-11T16:03:17.179463+0000","last_clean":"2024-06-11T16:03:17.179463+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:17.179463+0000","last_undegraded":"2024-06-11T16:03:17.179463+0000","last_fullsized":"2024-06-11T16:03:17.179463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":235,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180275+0000","last_change":"2024-06-11T16:03:16.194106+0000","last_active":"2024-06-11T16:03:17.180275+0000","last_peered":"2024-06-11T16:03:17.180275+0000","last_clean":"2024-06-11T16:00:49.278755+0000","last_became_active":"2024-06-11T16:03:16.193259+0000","last_became_peered":"2024-06-11T16:03:16.193259+0000","last_unstale":"2024-06-11T16:03:17.180275+0000","last_undegraded":"2024-06-11T16:03:16.177585+0000","last_fullsized":"2024-06-11T16:03:16.175596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":67}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179882+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:17.179882+0000","last_peered":"2024-06-11T16:03:17.179882+0000","last_clean":"2024-06-11T16:03:17.179882+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:17.179882+0000","last_undegraded":"2024-06-11T16:03:17.179882+0000","last_fullsized":"2024-06-11T16:03:17.179882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184212+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:18.184212+0000","last_peered":"2024-06-11T16:03:18.184212+0000","last_clean":"2024-06-11T16:03:18.184212+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:18.184212+0000","last_undegraded":"2024-06-11T16:03:18.184212+0000","last_fullsized":"2024-06-11T16:03:18.184212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":243,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178619+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:17.178619+0000","last_peered":"2024-06-11T16:03:17.178619+0000","last_clean":"2024-06-11T16:03:17.178619+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:17.178619+0000","last_undegraded":"2024-06-11T16:03:17.178619+0000","last_fullsized":"2024-06-11T16:03:17.178619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178880+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:18.178880+0000","last_peered":"2024-06-11T16:03:18.178880+0000","last_clean":"2024-06-11T16:03:18.178880+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:18.178880+0000","last_undegraded":"2024-06-11T16:03:18.178880+0000","last_fullsized":"2024-06-11T16:03:18.178880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":237,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179781+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:17.179781+0000","last_peered":"2024-06-11T16:03:17.179781+0000","last_clean":"2024-06-11T16:03:17.179781+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:17.179781+0000","last_undegraded":"2024-06-11T16:03:17.179781+0000","last_fullsized":"2024-06-11T16:03:17.179781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":152,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180574+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:17.180574+0000","last_peered":"2024-06-11T16:03:17.180574+0000","last_clean":"2024-06-11T16:03:17.180574+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:17.180574+0000","last_undegraded":"2024-06-11T16:03:17.180574+0000","last_fullsized":"2024-06-11T16:03:17.180574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182098+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:17.182098+0000","last_peered":"2024-06-11T16:03:17.182098+0000","last_clean":"2024-06-11T16:03:17.182098+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:17.182098+0000","last_undegraded":"2024-06-11T16:03:17.182098+0000","last_fullsized":"2024-06-11T16:03:17.182098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179206+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:17.179206+0000","last_peered":"2024-06-11T16:03:17.179206+0000","last_clean":"2024-06-11T16:03:17.179206+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:17.179206+0000","last_undegraded":"2024-06-11T16:03:17.179206+0000","last_fullsized":"2024-06-11T16:03:17.179206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180961+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:17.180961+0000","last_peered":"2024-06-11T16:03:17.180961+0000","last_clean":"2024-06-11T16:03:17.180961+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:17.180961+0000","last_undegraded":"2024-06-11T16:03:17.180961+0000","last_fullsized":"2024-06-11T16:03:17.180961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179354+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:18.179354+0000","last_peered":"2024-06-11T16:03:18.179354+0000","last_clean":"2024-06-11T16:03:18.179354+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:18.179354+0000","last_undegraded":"2024-06-11T16:03:18.179354+0000","last_fullsized":"2024-06-11T16:03:18.179354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179114+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:18.179114+0000","last_peered":"2024-06-11T16:03:18.179114+0000","last_clean":"2024-06-11T16:03:18.179114+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:18.179114+0000","last_undegraded":"2024-06-11T16:03:18.179114+0000","last_fullsized":"2024-06-11T16:03:18.179114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.177782+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:17.177782+0000","last_peered":"2024-06-11T16:03:17.177782+0000","last_clean":"2024-06-11T16:03:17.177782+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:17.177782+0000","last_undegraded":"2024-06-11T16:03:17.177782+0000","last_fullsized":"2024-06-11T16:03:17.177782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178957+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:17.178957+0000","last_peered":"2024-06-11T16:03:17.178957+0000","last_clean":"2024-06-11T16:03:17.178957+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:17.178957+0000","last_undegraded":"2024-06-11T16:03:17.178957+0000","last_fullsized":"2024-06-11T16:03:17.178957+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":267,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178333+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:17.178333+0000","last_peered":"2024-06-11T16:03:17.178333+0000","last_clean":"2024-06-11T16:03:17.178333+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:17.178333+0000","last_undegraded":"2024-06-11T16:03:17.178333+0000","last_fullsized":"2024-06-11T16:03:17.178333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179955+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:18.179955+0000","last_peered":"2024-06-11T16:03:18.179955+0000","last_clean":"2024-06-11T16:03:18.179955+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:18.179955+0000","last_undegraded":"2024-06-11T16:03:18.179955+0000","last_fullsized":"2024-06-11T16:03:18.179955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":270,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.181198+0000","last_change":"2024-06-11T16:03:16.192499+0000","last_active":"2024-06-11T16:03:17.181198+0000","last_peered":"2024-06-11T16:03:17.181198+0000","last_clean":"2024-06-11T16:03:13.145765+0000","last_became_active":"2024-06-11T16:03:16.191847+0000","last_became_peered":"2024-06-11T16:03:16.191847+0000","last_unstale":"2024-06-11T16:03:17.181198+0000","last_undegraded":"2024-06-11T16:03:16.166138+0000","last_fullsized":"2024-06-11T16:03:16.164953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179537+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:18.179537+0000","last_peered":"2024-06-11T16:03:18.179537+0000","last_clean":"2024-06-11T16:03:18.179537+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:18.179537+0000","last_undegraded":"2024-06-11T16:03:18.179537+0000","last_fullsized":"2024-06-11T16:03:18.179537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":317,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179491+0000","last_change":"2024-06-11T16:03:16.191512+0000","last_active":"2024-06-11T16:03:17.179491+0000","last_peered":"2024-06-11T16:03:17.179491+0000","last_clean":"2024-06-11T16:03:13.144603+0000","last_became_active":"2024-06-11T16:03:16.190589+0000","last_became_peered":"2024-06-11T16:03:16.190589+0000","last_unstale":"2024-06-11T16:03:17.179491+0000","last_undegraded":"2024-06-11T16:03:16.168532+0000","last_fullsized":"2024-06-11T16:03:16.166580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179803+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:17.179803+0000","last_peered":"2024-06-11T16:03:17.179803+0000","last_clean":"2024-06-11T16:03:17.179803+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:17.179803+0000","last_undegraded":"2024-06-11T16:03:17.179803+0000","last_fullsized":"2024-06-11T16:03:17.179803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":281,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179286+0000","last_change":"2024-06-11T16:03:16.188586+0000","last_active":"2024-06-11T16:03:17.179286+0000","last_peered":"2024-06-11T16:03:17.179286+0000","last_clean":"2024-06-11T16:03:13.144491+0000","last_became_active":"2024-06-11T16:03:16.187988+0000","last_became_peered":"2024-06-11T16:03:16.187988+0000","last_unstale":"2024-06-11T16:03:17.179286+0000","last_undegraded":"2024-06-11T16:03:16.165185+0000","last_fullsized":"2024-06-11T16:03:16.159943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178823+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:18.178823+0000","last_peered":"2024-06-11T16:03:18.178823+0000","last_clean":"2024-06-11T16:03:18.178823+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:18.178823+0000","last_undegraded":"2024-06-11T16:03:18.178823+0000","last_fullsized":"2024-06-11T16:03:18.178823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":267,"reported_epoch":84,"state":"active+recovering+undersized+remapped","last_fresh":"2024-06-11T16:03:18.128201+0000","last_change":"2024-06-11T16:03:18.071702+0000","last_active":"2024-06-11T16:03:18.128201+0000","last_peered":"2024-06-11T16:03:18.128201+0000","last_clean":"2024-06-11T16:00:54.881776+0000","last_became_active":"2024-06-11T16:03:16.191861+0000","last_became_peered":"2024-06-11T16:03:16.191861+0000","last_unstale":"2024-06-11T16:03:18.128201+0000","last_undegraded":"2024-06-11T16:03:18.128201+0000","last_fullsized":"2024-06-11T16:03:16.175219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":25864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":34},{"shards":"1","objects":24}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179338+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:17.179338+0000","last_peered":"2024-06-11T16:03:17.179338+0000","last_clean":"2024-06-11T16:03:17.179338+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:17.179338+0000","last_undegraded":"2024-06-11T16:03:17.179338+0000","last_fullsized":"2024-06-11T16:03:17.179338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":224,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.440008+0000","last_change":"2024-06-11T16:03:19.078787+0000","last_active":"2024-06-11T16:03:19.078787+0000","last_peered":"2024-06-11T16:03:17.440008+0000","last_clean":"2024-06-11T16:03:12.135478+0000","last_became_active":"2024-06-11T16:03:16.184920+0000","last_became_peered":"2024-06-11T16:03:16.184920+0000","last_unstale":"2024-06-11T16:03:17.440008+0000","last_undegraded":"2024-06-11T16:03:17.440008+0000","last_fullsized":"2024-06-11T16:03:17.440008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178361+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:17.178361+0000","last_peered":"2024-06-11T16:03:17.178361+0000","last_clean":"2024-06-11T16:03:17.178361+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:17.178361+0000","last_undegraded":"2024-06-11T16:03:17.178361+0000","last_fullsized":"2024-06-11T16:03:17.178361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180989+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:17.180989+0000","last_peered":"2024-06-11T16:03:17.180989+0000","last_clean":"2024-06-11T16:03:17.180989+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:17.180989+0000","last_undegraded":"2024-06-11T16:03:17.180989+0000","last_fullsized":"2024-06-11T16:03:17.180989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":239,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.443714+0000","last_change":"2024-06-11T16:03:19.078630+0000","last_active":"2024-06-11T16:03:19.078630+0000","last_peered":"2024-06-11T16:03:17.443714+0000","last_clean":"2024-06-11T15:58:53.120953+0000","last_became_active":"2024-06-11T16:03:16.191135+0000","last_became_peered":"2024-06-11T16:03:16.191135+0000","last_unstale":"2024-06-11T16:03:17.443714+0000","last_undegraded":"2024-06-11T16:03:17.443714+0000","last_fullsized":"2024-06-11T16:03:16.164894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178783+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:18.178783+0000","last_peered":"2024-06-11T16:03:18.178783+0000","last_clean":"2024-06-11T16:03:18.178783+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:18.178783+0000","last_undegraded":"2024-06-11T16:03:18.178783+0000","last_fullsized":"2024-06-11T16:03:18.178783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":170,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181497+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:17.181497+0000","last_peered":"2024-06-11T16:03:17.181497+0000","last_clean":"2024-06-11T16:03:17.181497+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:17.181497+0000","last_undegraded":"2024-06-11T16:03:17.181497+0000","last_fullsized":"2024-06-11T16:03:17.181497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":202,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.948980+0000","last_change":"2024-06-11T16:03:19.078773+0000","last_active":"2024-06-11T16:03:19.078773+0000","last_peered":"2024-06-11T16:03:17.948980+0000","last_clean":"2024-06-11T16:00:54.882186+0000","last_became_active":"2024-06-11T16:03:16.191785+0000","last_became_peered":"2024-06-11T16:03:16.191785+0000","last_unstale":"2024-06-11T16:03:17.948980+0000","last_undegraded":"2024-06-11T16:03:17.948980+0000","last_fullsized":"2024-06-11T16:03:16.162689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179560+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:18.179560+0000","last_peered":"2024-06-11T16:03:18.179560+0000","last_clean":"2024-06-11T16:03:18.179560+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:18.179560+0000","last_undegraded":"2024-06-11T16:03:18.179560+0000","last_fullsized":"2024-06-11T16:03:18.179560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":236,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180143+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:17.180143+0000","last_peered":"2024-06-11T16:03:17.180143+0000","last_clean":"2024-06-11T16:03:17.180143+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:17.180143+0000","last_undegraded":"2024-06-11T16:03:17.180143+0000","last_fullsized":"2024-06-11T16:03:17.180143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178783+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:17.178783+0000","last_peered":"2024-06-11T16:03:17.178783+0000","last_clean":"2024-06-11T16:03:17.178783+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:17.178783+0000","last_undegraded":"2024-06-11T16:03:17.178783+0000","last_fullsized":"2024-06-11T16:03:17.178783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180383+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:17.180383+0000","last_peered":"2024-06-11T16:03:17.180383+0000","last_clean":"2024-06-11T16:03:17.180383+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:17.180383+0000","last_undegraded":"2024-06-11T16:03:17.180383+0000","last_fullsized":"2024-06-11T16:03:17.180383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178212+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:17.178212+0000","last_peered":"2024-06-11T16:03:17.178212+0000","last_clean":"2024-06-11T16:03:17.178212+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:17.178212+0000","last_undegraded":"2024-06-11T16:03:17.178212+0000","last_fullsized":"2024-06-11T16:03:17.178212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181052+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:17.181052+0000","last_peered":"2024-06-11T16:03:17.181052+0000","last_clean":"2024-06-11T16:03:17.181052+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:17.181052+0000","last_undegraded":"2024-06-11T16:03:17.181052+0000","last_fullsized":"2024-06-11T16:03:17.181052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178739+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:18.178739+0000","last_peered":"2024-06-11T16:03:18.178739+0000","last_clean":"2024-06-11T16:03:18.178739+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:18.178739+0000","last_undegraded":"2024-06-11T16:03:18.178739+0000","last_fullsized":"2024-06-11T16:03:18.178739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178519+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:18.178519+0000","last_peered":"2024-06-11T16:03:18.178519+0000","last_clean":"2024-06-11T16:03:18.178519+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:18.178519+0000","last_undegraded":"2024-06-11T16:03:18.178519+0000","last_fullsized":"2024-06-11T16:03:18.178519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180246+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:17.180246+0000","last_peered":"2024-06-11T16:03:17.180246+0000","last_clean":"2024-06-11T16:03:17.180246+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:17.180246+0000","last_undegraded":"2024-06-11T16:03:17.180246+0000","last_fullsized":"2024-06-11T16:03:17.180246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180209+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:18.180209+0000","last_peered":"2024-06-11T16:03:18.180209+0000","last_clean":"2024-06-11T16:03:18.180209+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:18.180209+0000","last_undegraded":"2024-06-11T16:03:18.180209+0000","last_fullsized":"2024-06-11T16:03:18.180209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180464+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:17.180464+0000","last_peered":"2024-06-11T16:03:17.180464+0000","last_clean":"2024-06-11T16:03:17.180464+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:17.180464+0000","last_undegraded":"2024-06-11T16:03:17.180464+0000","last_fullsized":"2024-06-11T16:03:17.180464+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":209,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179690+0000","last_change":"2024-06-11T16:03:16.193053+0000","last_active":"2024-06-11T16:03:17.179690+0000","last_peered":"2024-06-11T16:03:17.179690+0000","last_clean":"2024-06-11T16:00:49.275319+0000","last_became_active":"2024-06-11T16:03:16.192031+0000","last_became_peered":"2024-06-11T16:03:16.192031+0000","last_unstale":"2024-06-11T16:03:17.179690+0000","last_undegraded":"2024-06-11T16:03:16.177017+0000","last_fullsized":"2024-06-11T16:03:16.175201+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":95,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":40}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180359+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:17.180359+0000","last_peered":"2024-06-11T16:03:17.180359+0000","last_clean":"2024-06-11T16:03:17.180359+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:17.180359+0000","last_undegraded":"2024-06-11T16:03:17.180359+0000","last_fullsized":"2024-06-11T16:03:17.180359+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180454+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:17.180454+0000","last_peered":"2024-06-11T16:03:17.180454+0000","last_clean":"2024-06-11T16:03:17.180454+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:17.180454+0000","last_undegraded":"2024-06-11T16:03:17.180454+0000","last_fullsized":"2024-06-11T16:03:17.180454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":232,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179384+0000","last_change":"2024-06-11T16:03:16.193264+0000","last_active":"2024-06-11T16:03:17.179384+0000","last_peered":"2024-06-11T16:03:17.179384+0000","last_clean":"2024-06-11T16:00:51.883199+0000","last_became_active":"2024-06-11T16:03:16.192397+0000","last_became_peered":"2024-06-11T16:03:16.192397+0000","last_unstale":"2024-06-11T16:03:17.179384+0000","last_undegraded":"2024-06-11T16:03:16.178925+0000","last_fullsized":"2024-06-11T16:03:16.176807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":113,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":53}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":148,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181264+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:17.181264+0000","last_peered":"2024-06-11T16:03:17.181264+0000","last_clean":"2024-06-11T16:03:17.181264+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:17.181264+0000","last_undegraded":"2024-06-11T16:03:17.181264+0000","last_fullsized":"2024-06-11T16:03:17.181264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182211+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:17.182211+0000","last_peered":"2024-06-11T16:03:17.182211+0000","last_clean":"2024-06-11T16:03:17.182211+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:17.182211+0000","last_undegraded":"2024-06-11T16:03:17.182211+0000","last_fullsized":"2024-06-11T16:03:17.182211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":300,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180679+0000","last_change":"2024-06-11T16:03:16.190115+0000","last_active":"2024-06-11T16:03:17.180679+0000","last_peered":"2024-06-11T16:03:17.180679+0000","last_clean":"2024-06-11T16:03:13.144927+0000","last_became_active":"2024-06-11T16:03:16.189305+0000","last_became_peered":"2024-06-11T16:03:16.189305+0000","last_unstale":"2024-06-11T16:03:17.180679+0000","last_undegraded":"2024-06-11T16:03:16.167879+0000","last_fullsized":"2024-06-11T16:03:16.164999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":202,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.182140+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:17.182140+0000","last_peered":"2024-06-11T16:03:17.182140+0000","last_clean":"2024-06-11T16:03:17.182140+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:17.182140+0000","last_undegraded":"2024-06-11T16:03:17.182140+0000","last_fullsized":"2024-06-11T16:03:17.182140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179070+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:18.179070+0000","last_peered":"2024-06-11T16:03:18.179070+0000","last_clean":"2024-06-11T16:03:18.179070+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:18.179070+0000","last_undegraded":"2024-06-11T16:03:18.179070+0000","last_fullsized":"2024-06-11T16:03:18.179070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":380,"reported_epoch":83,"state":"peering","last_fresh":"2024-06-11T16:03:16.776931+0000","last_change":"2024-06-11T16:03:17.179022+0000","last_active":"2024-06-11T16:03:17.179022+0000","last_peered":"2024-06-11T16:03:16.776931+0000","last_clean":"2024-06-11T16:00:51.883048+0000","last_became_active":"2024-06-11T16:03:16.190080+0000","last_became_peered":"2024-06-11T16:03:16.190080+0000","last_unstale":"2024-06-11T16:03:16.776931+0000","last_undegraded":"2024-06-11T16:03:16.776931+0000","last_fullsized":"2024-06-11T16:03:16.162599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":203,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178020+0000","last_change":"2024-06-11T16:03:16.193145+0000","last_active":"2024-06-11T16:03:17.178020+0000","last_peered":"2024-06-11T16:03:17.178020+0000","last_clean":"2024-06-11T16:00:49.663987+0000","last_became_active":"2024-06-11T16:03:16.192482+0000","last_became_peered":"2024-06-11T16:03:16.192482+0000","last_unstale":"2024-06-11T16:03:17.178020+0000","last_undegraded":"2024-06-11T16:03:16.179441+0000","last_fullsized":"2024-06-11T16:03:16.178454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179630+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:18.179630+0000","last_peered":"2024-06-11T16:03:18.179630+0000","last_clean":"2024-06-11T16:03:18.179630+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:18.179630+0000","last_undegraded":"2024-06-11T16:03:18.179630+0000","last_fullsized":"2024-06-11T16:03:18.179630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":288,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180302+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:17.180302+0000","last_peered":"2024-06-11T16:03:17.180302+0000","last_clean":"2024-06-11T16:03:17.180302+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:17.180302+0000","last_undegraded":"2024-06-11T16:03:17.180302+0000","last_fullsized":"2024-06-11T16:03:17.180302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180229+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:17.180229+0000","last_peered":"2024-06-11T16:03:17.180229+0000","last_clean":"2024-06-11T16:03:17.180229+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:17.180229+0000","last_undegraded":"2024-06-11T16:03:17.180229+0000","last_fullsized":"2024-06-11T16:03:17.180229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178653+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:18.178653+0000","last_peered":"2024-06-11T16:03:18.178653+0000","last_clean":"2024-06-11T16:03:18.178653+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:18.178653+0000","last_undegraded":"2024-06-11T16:03:18.178653+0000","last_fullsized":"2024-06-11T16:03:18.178653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":328,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179969+0000","last_change":"2024-06-11T16:03:16.187720+0000","last_active":"2024-06-11T16:03:17.179969+0000","last_peered":"2024-06-11T16:03:17.179969+0000","last_clean":"2024-06-11T16:03:13.142425+0000","last_became_active":"2024-06-11T16:03:16.186853+0000","last_became_peered":"2024-06-11T16:03:16.186853+0000","last_unstale":"2024-06-11T16:03:17.179969+0000","last_undegraded":"2024-06-11T16:03:16.166457+0000","last_fullsized":"2024-06-11T16:03:16.164143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":64}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":158,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181175+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:17.181175+0000","last_peered":"2024-06-11T16:03:17.181175+0000","last_clean":"2024-06-11T16:03:17.181175+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:17.181175+0000","last_undegraded":"2024-06-11T16:03:17.181175+0000","last_fullsized":"2024-06-11T16:03:17.181175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180557+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:17.180557+0000","last_peered":"2024-06-11T16:03:17.180557+0000","last_clean":"2024-06-11T16:03:17.180557+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:17.180557+0000","last_undegraded":"2024-06-11T16:03:17.180557+0000","last_fullsized":"2024-06-11T16:03:17.180557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179402+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:17.179402+0000","last_peered":"2024-06-11T16:03:17.179402+0000","last_clean":"2024-06-11T16:03:17.179402+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:17.179402+0000","last_undegraded":"2024-06-11T16:03:17.179402+0000","last_fullsized":"2024-06-11T16:03:17.179402+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":146,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181449+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:17.181449+0000","last_peered":"2024-06-11T16:03:17.181449+0000","last_clean":"2024-06-11T16:03:17.181449+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:17.181449+0000","last_undegraded":"2024-06-11T16:03:17.181449+0000","last_fullsized":"2024-06-11T16:03:17.181449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":506,"reported_epoch":84,"state":"active+undersized+remapped","last_fresh":"2024-06-11T16:03:17.822590+0000","last_change":"2024-06-11T16:03:17.822806+0000","last_active":"2024-06-11T16:03:17.822590+0000","last_peered":"2024-06-11T16:03:17.822590+0000","last_clean":"2024-06-11T16:03:13.147288+0000","last_became_active":"2024-06-11T16:03:16.186444+0000","last_became_peered":"2024-06-11T16:03:16.186444+0000","last_unstale":"2024-06-11T16:03:17.822590+0000","last_undegraded":"2024-06-11T16:03:17.822590+0000","last_fullsized":"2024-06-11T16:03:16.166311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":47}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180053+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:17.180053+0000","last_peered":"2024-06-11T16:03:17.180053+0000","last_clean":"2024-06-11T16:03:17.180053+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:17.180053+0000","last_undegraded":"2024-06-11T16:03:17.180053+0000","last_fullsized":"2024-06-11T16:03:17.180053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":198,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179432+0000","last_change":"2024-06-11T16:03:16.193737+0000","last_active":"2024-06-11T16:03:17.179432+0000","last_peered":"2024-06-11T16:03:17.179432+0000","last_clean":"2024-06-11T16:00:49.783464+0000","last_became_active":"2024-06-11T16:03:16.193263+0000","last_became_peered":"2024-06-11T16:03:16.193263+0000","last_unstale":"2024-06-11T16:03:17.179432+0000","last_undegraded":"2024-06-11T16:03:16.176440+0000","last_fullsized":"2024-06-11T16:03:16.175378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":96,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180299+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:17.180299+0000","last_peered":"2024-06-11T16:03:17.180299+0000","last_clean":"2024-06-11T16:03:17.180299+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:17.180299+0000","last_undegraded":"2024-06-11T16:03:17.180299+0000","last_fullsized":"2024-06-11T16:03:17.180299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":254,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.178537+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:17.178537+0000","last_peered":"2024-06-11T16:03:17.178537+0000","last_clean":"2024-06-11T16:03:17.178537+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:17.178537+0000","last_undegraded":"2024-06-11T16:03:17.178537+0000","last_fullsized":"2024-06-11T16:03:17.178537+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179505+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:17.179505+0000","last_peered":"2024-06-11T16:03:17.179505+0000","last_clean":"2024-06-11T16:03:17.179505+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:17.179505+0000","last_undegraded":"2024-06-11T16:03:17.179505+0000","last_fullsized":"2024-06-11T16:03:17.179505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":269,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179186+0000","last_change":"2024-06-11T16:03:16.191650+0000","last_active":"2024-06-11T16:03:17.179186+0000","last_peered":"2024-06-11T16:03:17.179186+0000","last_clean":"2024-06-11T16:03:13.142283+0000","last_became_active":"2024-06-11T16:03:16.190729+0000","last_became_peered":"2024-06-11T16:03:16.190729+0000","last_unstale":"2024-06-11T16:03:17.179186+0000","last_undegraded":"2024-06-11T16:03:16.166117+0000","last_fullsized":"2024-06-11T16:03:16.164379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179592+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:18.179592+0000","last_peered":"2024-06-11T16:03:18.179592+0000","last_clean":"2024-06-11T16:03:18.179592+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:18.179592+0000","last_undegraded":"2024-06-11T16:03:18.179592+0000","last_fullsized":"2024-06-11T16:03:18.179592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":267,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180520+0000","last_change":"2024-06-11T16:03:16.192319+0000","last_active":"2024-06-11T16:03:17.180520+0000","last_peered":"2024-06-11T16:03:17.180520+0000","last_clean":"2024-06-11T16:03:13.145653+0000","last_became_active":"2024-06-11T16:03:16.191660+0000","last_became_peered":"2024-06-11T16:03:16.191660+0000","last_unstale":"2024-06-11T16:03:17.180520+0000","last_undegraded":"2024-06-11T16:03:16.167404+0000","last_fullsized":"2024-06-11T16:03:16.164859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.180133+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:17.180133+0000","last_peered":"2024-06-11T16:03:17.180133+0000","last_clean":"2024-06-11T16:03:17.180133+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:17.180133+0000","last_undegraded":"2024-06-11T16:03:17.180133+0000","last_fullsized":"2024-06-11T16:03:17.180133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":262,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.179399+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:17.179399+0000","last_peered":"2024-06-11T16:03:17.179399+0000","last_clean":"2024-06-11T16:03:17.179399+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:17.179399+0000","last_undegraded":"2024-06-11T16:03:17.179399+0000","last_fullsized":"2024-06-11T16:03:17.179399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":149,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181607+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:17.181607+0000","last_peered":"2024-06-11T16:03:17.181607+0000","last_clean":"2024-06-11T16:03:17.181607+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:17.181607+0000","last_undegraded":"2024-06-11T16:03:17.181607+0000","last_fullsized":"2024-06-11T16:03:17.181607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":297,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179603+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:18.179603+0000","last_peered":"2024-06-11T16:03:18.179603+0000","last_clean":"2024-06-11T16:03:18.179603+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:18.179603+0000","last_undegraded":"2024-06-11T16:03:18.179603+0000","last_fullsized":"2024-06-11T16:03:18.179603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-06-11T16:03:17.181083+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:17.181083+0000","last_peered":"2024-06-11T16:03:17.181083+0000","last_clean":"2024-06-11T16:03:17.181083+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:17.181083+0000","last_undegraded":"2024-06-11T16:03:17.181083+0000","last_fullsized":"2024-06-11T16:03:17.181083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1676,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2171,"num_bytes_recovered":8609565,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74182656,"data_stored":61283340,"data_compressed":5274910,"data_compressed_allocated":6189056,"data_compressed_original":16252928,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":108,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":84874432,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49760,"kb_used_data":22224,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94322080,"statfs":{"total":96636764160,"available":96585809920,"internally_reserved":0,"allocated":22757376,"data_stored":48965737,"data_compressed":5999773,"data_compressed_allocated":7065600,"data_compressed_original":37867520,"omap_allocated":7164,"internal_metadata":28173316},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89456,"kb_used_data":31900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94282384,"statfs":{"total":96636764160,"available":96545161216,"internally_reserved":0,"allocated":32665600,"data_stored":51358741,"data_compressed":6440081,"data_compressed_allocated":7618560,"data_compressed_original":35721216,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93104,"kb_used_data":35552,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278736,"statfs":{"total":96636764160,"available":96541425664,"internally_reserved":0,"allocated":36405248,"data_stored":48372234,"data_compressed":5307051,"data_compressed_allocated":6299648,"data_compressed_original":28110848,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":21464877,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31338496,"data_stored":25976002,"data_compressed":2198540,"data_compressed_allocated":2572288,"data_compressed_original":6660096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26144768,"data_stored":20903296,"data_compressed":2015679,"data_compressed_allocated":2363392,"data_compressed_original":6131712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16699392,"data_stored":14404042,"data_compressed":1060691,"data_compressed_allocated":1253376,"data_compressed_original":3461120,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:23.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:23.670 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:23.671 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:23.681 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-06-11T16:03:23.646471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":708,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3176,"num_bytes_recovered":41448639,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":220584,"kb_used_data":77948,"kb_used_omap":10,"kb_used_meta":142581,"kb_avail":282894936,"statfs":{"total":289910292480,"available":289684414464,"internally_reserved":0,"allocated":79818752,"data_stored":138501207,"data_compressed":16785861,"data_compressed_allocated":19832832,"data_compressed_original":98152448,"omap_allocated":10353,"internal_metadata":146003855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-968,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":968,"num_bytes_recovered":1973043,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000794"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":236,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.320321+0000","last_change":"2024-06-11T16:03:19.078765+0000","last_active":"2024-06-11T16:03:19.078765+0000","last_peered":"2024-06-11T16:03:17.320321+0000","last_clean":"2024-06-11T16:00:50.272256+0000","last_became_active":"2024-06-11T16:03:16.189967+0000","last_became_peered":"2024-06-11T16:03:16.189967+0000","last_unstale":"2024-06-11T16:03:17.320321+0000","last_undegraded":"2024-06-11T16:03:17.320321+0000","last_fullsized":"2024-06-11T16:03:16.159979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":231,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:18.069662+0000","last_change":"2024-06-11T16:03:19.078732+0000","last_active":"2024-06-11T16:03:19.078732+0000","last_peered":"2024-06-11T16:03:18.069662+0000","last_clean":"2024-06-11T16:03:13.145938+0000","last_became_active":"2024-06-11T16:03:16.186231+0000","last_became_peered":"2024-06-11T16:03:16.186231+0000","last_unstale":"2024-06-11T16:03:18.069662+0000","last_undegraded":"2024-06-11T16:03:18.069662+0000","last_fullsized":"2024-06-11T16:03:16.160424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183982+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:18.183982+0000","last_peered":"2024-06-11T16:03:18.183982+0000","last_clean":"2024-06-11T16:03:18.183982+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:18.183982+0000","last_undegraded":"2024-06-11T16:03:18.183982+0000","last_fullsized":"2024-06-11T16:03:18.183982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183991+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:18.183991+0000","last_peered":"2024-06-11T16:03:18.183991+0000","last_clean":"2024-06-11T16:03:18.183991+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:18.183991+0000","last_undegraded":"2024-06-11T16:03:18.183991+0000","last_fullsized":"2024-06-11T16:03:18.183991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":238,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180398+0000","last_change":"2024-06-11T16:03:16.189003+0000","last_active":"2024-06-11T16:03:17.180398+0000","last_peered":"2024-06-11T16:03:17.180398+0000","last_clean":"2024-06-11T16:03:13.142708+0000","last_became_active":"2024-06-11T16:03:16.188468+0000","last_became_peered":"2024-06-11T16:03:16.188468+0000","last_unstale":"2024-06-11T16:03:17.180398+0000","last_undegraded":"2024-06-11T16:03:16.162443+0000","last_fullsized":"2024-06-11T16:03:16.160406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":242,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180724+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:18.180724+0000","last_peered":"2024-06-11T16:03:18.180724+0000","last_clean":"2024-06-11T16:03:18.180724+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:18.180724+0000","last_undegraded":"2024-06-11T16:03:18.180724+0000","last_fullsized":"2024-06-11T16:03:18.180724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":273,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179296+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:18.179296+0000","last_peered":"2024-06-11T16:03:18.179296+0000","last_clean":"2024-06-11T16:03:18.179296+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:18.179296+0000","last_undegraded":"2024-06-11T16:03:18.179296+0000","last_fullsized":"2024-06-11T16:03:18.179296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184216+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:18.184216+0000","last_peered":"2024-06-11T16:03:18.184216+0000","last_clean":"2024-06-11T16:03:18.184216+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:18.184216+0000","last_undegraded":"2024-06-11T16:03:18.184216+0000","last_fullsized":"2024-06-11T16:03:18.184216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179647+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:18.179647+0000","last_peered":"2024-06-11T16:03:18.179647+0000","last_clean":"2024-06-11T16:03:18.179647+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:18.179647+0000","last_undegraded":"2024-06-11T16:03:18.179647+0000","last_fullsized":"2024-06-11T16:03:18.179647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179717+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:18.179717+0000","last_peered":"2024-06-11T16:03:18.179717+0000","last_clean":"2024-06-11T16:03:18.179717+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:18.179717+0000","last_undegraded":"2024-06-11T16:03:18.179717+0000","last_fullsized":"2024-06-11T16:03:18.179717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":260,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.197243+0000","last_change":"2024-06-11T16:03:19.078723+0000","last_active":"2024-06-11T16:03:19.078723+0000","last_peered":"2024-06-11T16:03:17.197243+0000","last_clean":"2024-06-11T16:03:13.145303+0000","last_became_active":"2024-06-11T16:03:16.182774+0000","last_became_peered":"2024-06-11T16:03:16.182774+0000","last_unstale":"2024-06-11T16:03:17.197243+0000","last_undegraded":"2024-06-11T16:03:17.197243+0000","last_fullsized":"2024-06-11T16:03:16.158479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":211,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180349+0000","last_change":"2024-06-11T16:03:16.195303+0000","last_active":"2024-06-11T16:03:17.180349+0000","last_peered":"2024-06-11T16:03:17.180349+0000","last_clean":"2024-06-11T16:00:51.884795+0000","last_became_active":"2024-06-11T16:03:16.194759+0000","last_became_peered":"2024-06-11T16:03:16.194759+0000","last_unstale":"2024-06-11T16:03:17.180349+0000","last_undegraded":"2024-06-11T16:03:16.179951+0000","last_fullsized":"2024-06-11T16:03:16.178957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184212+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:18.184212+0000","last_peered":"2024-06-11T16:03:18.184212+0000","last_clean":"2024-06-11T16:03:18.184212+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:18.184212+0000","last_undegraded":"2024-06-11T16:03:18.184212+0000","last_fullsized":"2024-06-11T16:03:18.184212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178880+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:18.178880+0000","last_peered":"2024-06-11T16:03:18.178880+0000","last_clean":"2024-06-11T16:03:18.178880+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:18.178880+0000","last_undegraded":"2024-06-11T16:03:18.178880+0000","last_fullsized":"2024-06-11T16:03:18.178880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179354+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:18.179354+0000","last_peered":"2024-06-11T16:03:18.179354+0000","last_clean":"2024-06-11T16:03:18.179354+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:18.179354+0000","last_undegraded":"2024-06-11T16:03:18.179354+0000","last_fullsized":"2024-06-11T16:03:18.179354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179114+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:18.179114+0000","last_peered":"2024-06-11T16:03:18.179114+0000","last_clean":"2024-06-11T16:03:18.179114+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:18.179114+0000","last_undegraded":"2024-06-11T16:03:18.179114+0000","last_fullsized":"2024-06-11T16:03:18.179114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179955+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:18.179955+0000","last_peered":"2024-06-11T16:03:18.179955+0000","last_clean":"2024-06-11T16:03:18.179955+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:18.179955+0000","last_undegraded":"2024-06-11T16:03:18.179955+0000","last_fullsized":"2024-06-11T16:03:18.179955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":270,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.181198+0000","last_change":"2024-06-11T16:03:16.192499+0000","last_active":"2024-06-11T16:03:17.181198+0000","last_peered":"2024-06-11T16:03:17.181198+0000","last_clean":"2024-06-11T16:03:13.145765+0000","last_became_active":"2024-06-11T16:03:16.191847+0000","last_became_peered":"2024-06-11T16:03:16.191847+0000","last_unstale":"2024-06-11T16:03:17.181198+0000","last_undegraded":"2024-06-11T16:03:16.166138+0000","last_fullsized":"2024-06-11T16:03:16.164953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179537+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:18.179537+0000","last_peered":"2024-06-11T16:03:18.179537+0000","last_clean":"2024-06-11T16:03:18.179537+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:18.179537+0000","last_undegraded":"2024-06-11T16:03:18.179537+0000","last_fullsized":"2024-06-11T16:03:18.179537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":281,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179286+0000","last_change":"2024-06-11T16:03:16.188586+0000","last_active":"2024-06-11T16:03:17.179286+0000","last_peered":"2024-06-11T16:03:17.179286+0000","last_clean":"2024-06-11T16:03:13.144491+0000","last_became_active":"2024-06-11T16:03:16.187988+0000","last_became_peered":"2024-06-11T16:03:16.187988+0000","last_unstale":"2024-06-11T16:03:17.179286+0000","last_undegraded":"2024-06-11T16:03:16.165185+0000","last_fullsized":"2024-06-11T16:03:16.159943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178823+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:18.178823+0000","last_peered":"2024-06-11T16:03:18.178823+0000","last_clean":"2024-06-11T16:03:18.178823+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:18.178823+0000","last_undegraded":"2024-06-11T16:03:18.178823+0000","last_fullsized":"2024-06-11T16:03:18.178823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":267,"reported_epoch":84,"state":"active+recovering+undersized+remapped","last_fresh":"2024-06-11T16:03:18.128201+0000","last_change":"2024-06-11T16:03:18.071702+0000","last_active":"2024-06-11T16:03:18.128201+0000","last_peered":"2024-06-11T16:03:18.128201+0000","last_clean":"2024-06-11T16:00:54.881776+0000","last_became_active":"2024-06-11T16:03:16.191861+0000","last_became_peered":"2024-06-11T16:03:16.191861+0000","last_unstale":"2024-06-11T16:03:18.128201+0000","last_undegraded":"2024-06-11T16:03:18.128201+0000","last_fullsized":"2024-06-11T16:03:16.175219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":25864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":34},{"shards":"1","objects":24}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":224,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.440008+0000","last_change":"2024-06-11T16:03:19.078787+0000","last_active":"2024-06-11T16:03:19.078787+0000","last_peered":"2024-06-11T16:03:17.440008+0000","last_clean":"2024-06-11T16:03:12.135478+0000","last_became_active":"2024-06-11T16:03:16.184920+0000","last_became_peered":"2024-06-11T16:03:16.184920+0000","last_unstale":"2024-06-11T16:03:17.440008+0000","last_undegraded":"2024-06-11T16:03:17.440008+0000","last_fullsized":"2024-06-11T16:03:17.440008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":239,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.443714+0000","last_change":"2024-06-11T16:03:19.078630+0000","last_active":"2024-06-11T16:03:19.078630+0000","last_peered":"2024-06-11T16:03:17.443714+0000","last_clean":"2024-06-11T15:58:53.120953+0000","last_became_active":"2024-06-11T16:03:16.191135+0000","last_became_peered":"2024-06-11T16:03:16.191135+0000","last_unstale":"2024-06-11T16:03:17.443714+0000","last_undegraded":"2024-06-11T16:03:17.443714+0000","last_fullsized":"2024-06-11T16:03:16.164894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178783+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:18.178783+0000","last_peered":"2024-06-11T16:03:18.178783+0000","last_clean":"2024-06-11T16:03:18.178783+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:18.178783+0000","last_undegraded":"2024-06-11T16:03:18.178783+0000","last_fullsized":"2024-06-11T16:03:18.178783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":202,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.948980+0000","last_change":"2024-06-11T16:03:19.078773+0000","last_active":"2024-06-11T16:03:19.078773+0000","last_peered":"2024-06-11T16:03:17.948980+0000","last_clean":"2024-06-11T16:00:54.882186+0000","last_became_active":"2024-06-11T16:03:16.191785+0000","last_became_peered":"2024-06-11T16:03:16.191785+0000","last_unstale":"2024-06-11T16:03:17.948980+0000","last_undegraded":"2024-06-11T16:03:17.948980+0000","last_fullsized":"2024-06-11T16:03:16.162689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179560+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:18.179560+0000","last_peered":"2024-06-11T16:03:18.179560+0000","last_clean":"2024-06-11T16:03:18.179560+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:18.179560+0000","last_undegraded":"2024-06-11T16:03:18.179560+0000","last_fullsized":"2024-06-11T16:03:18.179560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178739+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:18.178739+0000","last_peered":"2024-06-11T16:03:18.178739+0000","last_clean":"2024-06-11T16:03:18.178739+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:18.178739+0000","last_undegraded":"2024-06-11T16:03:18.178739+0000","last_fullsized":"2024-06-11T16:03:18.178739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178519+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:18.178519+0000","last_peered":"2024-06-11T16:03:18.178519+0000","last_clean":"2024-06-11T16:03:18.178519+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:18.178519+0000","last_undegraded":"2024-06-11T16:03:18.178519+0000","last_fullsized":"2024-06-11T16:03:18.178519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180209+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:18.180209+0000","last_peered":"2024-06-11T16:03:18.180209+0000","last_clean":"2024-06-11T16:03:18.180209+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:18.180209+0000","last_undegraded":"2024-06-11T16:03:18.180209+0000","last_fullsized":"2024-06-11T16:03:18.180209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179070+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:18.179070+0000","last_peered":"2024-06-11T16:03:18.179070+0000","last_clean":"2024-06-11T16:03:18.179070+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:18.179070+0000","last_undegraded":"2024-06-11T16:03:18.179070+0000","last_fullsized":"2024-06-11T16:03:18.179070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":203,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178020+0000","last_change":"2024-06-11T16:03:16.193145+0000","last_active":"2024-06-11T16:03:17.178020+0000","last_peered":"2024-06-11T16:03:17.178020+0000","last_clean":"2024-06-11T16:00:49.663987+0000","last_became_active":"2024-06-11T16:03:16.192482+0000","last_became_peered":"2024-06-11T16:03:16.192482+0000","last_unstale":"2024-06-11T16:03:17.178020+0000","last_undegraded":"2024-06-11T16:03:16.179441+0000","last_fullsized":"2024-06-11T16:03:16.178454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179630+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:18.179630+0000","last_peered":"2024-06-11T16:03:18.179630+0000","last_clean":"2024-06-11T16:03:18.179630+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:18.179630+0000","last_undegraded":"2024-06-11T16:03:18.179630+0000","last_fullsized":"2024-06-11T16:03:18.179630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178653+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:18.178653+0000","last_peered":"2024-06-11T16:03:18.178653+0000","last_clean":"2024-06-11T16:03:18.178653+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:18.178653+0000","last_undegraded":"2024-06-11T16:03:18.178653+0000","last_fullsized":"2024-06-11T16:03:18.178653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":269,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179186+0000","last_change":"2024-06-11T16:03:16.191650+0000","last_active":"2024-06-11T16:03:17.179186+0000","last_peered":"2024-06-11T16:03:17.179186+0000","last_clean":"2024-06-11T16:03:13.142283+0000","last_became_active":"2024-06-11T16:03:16.190729+0000","last_became_peered":"2024-06-11T16:03:16.190729+0000","last_unstale":"2024-06-11T16:03:17.179186+0000","last_undegraded":"2024-06-11T16:03:16.166117+0000","last_fullsized":"2024-06-11T16:03:16.164379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179592+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:18.179592+0000","last_peered":"2024-06-11T16:03:18.179592+0000","last_clean":"2024-06-11T16:03:18.179592+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:18.179592+0000","last_undegraded":"2024-06-11T16:03:18.179592+0000","last_fullsized":"2024-06-11T16:03:18.179592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":267,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180520+0000","last_change":"2024-06-11T16:03:16.192319+0000","last_active":"2024-06-11T16:03:17.180520+0000","last_peered":"2024-06-11T16:03:17.180520+0000","last_clean":"2024-06-11T16:03:13.145653+0000","last_became_active":"2024-06-11T16:03:16.191660+0000","last_became_peered":"2024-06-11T16:03:16.191660+0000","last_unstale":"2024-06-11T16:03:17.180520+0000","last_undegraded":"2024-06-11T16:03:16.167404+0000","last_fullsized":"2024-06-11T16:03:16.164859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":297,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179603+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:18.179603+0000","last_peered":"2024-06-11T16:03:18.179603+0000","last_clean":"2024-06-11T16:03:18.179603+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:18.179603+0000","last_undegraded":"2024-06-11T16:03:18.179603+0000","last_fullsized":"2024-06-11T16:03:18.179603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":708,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3139,"num_bytes_recovered":10582608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62111744,"data_stored":51632617,"data_compressed":4324879,"data_compressed_allocated":5074944,"data_compressed_original":13295616,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49760,"kb_used_data":22224,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94322080,"statfs":{"total":96636764160,"available":96585809920,"internally_reserved":0,"allocated":22757376,"data_stored":48965737,"data_compressed":5999773,"data_compressed_allocated":7065600,"data_compressed_original":37867520,"omap_allocated":7164,"internal_metadata":28173316},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16699392,"data_stored":14404042,"data_compressed":1060691,"data_compressed_allocated":1253376,"data_compressed_original":3461120,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:23.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-11T16:03:24.067 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:24.068 INFO:teuthology.orchestra.run.smithi089.stdout:{"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1676/6968 objects degraded (24.053%), 16 pgs degraded","count":16},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":283,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":3,"num_up_osds":3,"osd_up_since":1718121780,"num_in_osds":3,"osd_in_since":1718121520,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":77},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":16},{"state_name":"peering","count":8},{"state_name":"active+undersized+remapped","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":3484,"data_bytes":69803379,"bytes_used":237895680,"bytes_avail":289672396800,"bytes_total":289910292480,"inactive_pgs_ratio":0.076190479099750519,"degraded_objects":1676,"degraded_total":6968,"degraded_ratio":0.24052812858783007,"misplaced_objects":34,"misplaced_total":6968,"misplaced_ratio":0.0048794489092996553,"recovering_objects_per_sec":277,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1110,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4201}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-06-11T16:00:01.587769+0000","services":{}},"progress_events":{}} 2024-06-11T16:03:24.081 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-06-11T16:03:24.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:24.371 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:24.372 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:24.382 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-06-11T16:03:23.646471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":708,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3176,"num_bytes_recovered":41448639,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":220584,"kb_used_data":77948,"kb_used_omap":10,"kb_used_meta":142581,"kb_avail":282894936,"statfs":{"total":289910292480,"available":289684414464,"internally_reserved":0,"allocated":79818752,"data_stored":138501207,"data_compressed":16785861,"data_compressed_allocated":19832832,"data_compressed_original":98152448,"omap_allocated":10353,"internal_metadata":146003855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-968,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":968,"num_bytes_recovered":1973043,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000794"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":236,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.320321+0000","last_change":"2024-06-11T16:03:19.078765+0000","last_active":"2024-06-11T16:03:19.078765+0000","last_peered":"2024-06-11T16:03:17.320321+0000","last_clean":"2024-06-11T16:00:50.272256+0000","last_became_active":"2024-06-11T16:03:16.189967+0000","last_became_peered":"2024-06-11T16:03:16.189967+0000","last_unstale":"2024-06-11T16:03:17.320321+0000","last_undegraded":"2024-06-11T16:03:17.320321+0000","last_fullsized":"2024-06-11T16:03:16.159979+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":231,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:18.069662+0000","last_change":"2024-06-11T16:03:19.078732+0000","last_active":"2024-06-11T16:03:19.078732+0000","last_peered":"2024-06-11T16:03:18.069662+0000","last_clean":"2024-06-11T16:03:13.145938+0000","last_became_active":"2024-06-11T16:03:16.186231+0000","last_became_peered":"2024-06-11T16:03:16.186231+0000","last_unstale":"2024-06-11T16:03:18.069662+0000","last_undegraded":"2024-06-11T16:03:18.069662+0000","last_fullsized":"2024-06-11T16:03:16.160424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":285,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183982+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:18.183982+0000","last_peered":"2024-06-11T16:03:18.183982+0000","last_clean":"2024-06-11T16:03:18.183982+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:18.183982+0000","last_undegraded":"2024-06-11T16:03:18.183982+0000","last_fullsized":"2024-06-11T16:03:18.183982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.183991+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:18.183991+0000","last_peered":"2024-06-11T16:03:18.183991+0000","last_clean":"2024-06-11T16:03:18.183991+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:18.183991+0000","last_undegraded":"2024-06-11T16:03:18.183991+0000","last_fullsized":"2024-06-11T16:03:18.183991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":238,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180398+0000","last_change":"2024-06-11T16:03:16.189003+0000","last_active":"2024-06-11T16:03:17.180398+0000","last_peered":"2024-06-11T16:03:17.180398+0000","last_clean":"2024-06-11T16:03:13.142708+0000","last_became_active":"2024-06-11T16:03:16.188468+0000","last_became_peered":"2024-06-11T16:03:16.188468+0000","last_unstale":"2024-06-11T16:03:17.180398+0000","last_undegraded":"2024-06-11T16:03:16.162443+0000","last_fullsized":"2024-06-11T16:03:16.160406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":46}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":242,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180724+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:18.180724+0000","last_peered":"2024-06-11T16:03:18.180724+0000","last_clean":"2024-06-11T16:03:18.180724+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:18.180724+0000","last_undegraded":"2024-06-11T16:03:18.180724+0000","last_fullsized":"2024-06-11T16:03:18.180724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":273,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179296+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:18.179296+0000","last_peered":"2024-06-11T16:03:18.179296+0000","last_clean":"2024-06-11T16:03:18.179296+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:18.179296+0000","last_undegraded":"2024-06-11T16:03:18.179296+0000","last_fullsized":"2024-06-11T16:03:18.179296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":226,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184216+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:18.184216+0000","last_peered":"2024-06-11T16:03:18.184216+0000","last_clean":"2024-06-11T16:03:18.184216+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:18.184216+0000","last_undegraded":"2024-06-11T16:03:18.184216+0000","last_fullsized":"2024-06-11T16:03:18.184216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179647+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:18.179647+0000","last_peered":"2024-06-11T16:03:18.179647+0000","last_clean":"2024-06-11T16:03:18.179647+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:18.179647+0000","last_undegraded":"2024-06-11T16:03:18.179647+0000","last_fullsized":"2024-06-11T16:03:18.179647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":272,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179717+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:18.179717+0000","last_peered":"2024-06-11T16:03:18.179717+0000","last_clean":"2024-06-11T16:03:18.179717+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:18.179717+0000","last_undegraded":"2024-06-11T16:03:18.179717+0000","last_fullsized":"2024-06-11T16:03:18.179717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":260,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.197243+0000","last_change":"2024-06-11T16:03:19.078723+0000","last_active":"2024-06-11T16:03:19.078723+0000","last_peered":"2024-06-11T16:03:17.197243+0000","last_clean":"2024-06-11T16:03:13.145303+0000","last_became_active":"2024-06-11T16:03:16.182774+0000","last_became_peered":"2024-06-11T16:03:16.182774+0000","last_unstale":"2024-06-11T16:03:17.197243+0000","last_undegraded":"2024-06-11T16:03:17.197243+0000","last_fullsized":"2024-06-11T16:03:16.158479+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":211,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180349+0000","last_change":"2024-06-11T16:03:16.195303+0000","last_active":"2024-06-11T16:03:17.180349+0000","last_peered":"2024-06-11T16:03:17.180349+0000","last_clean":"2024-06-11T16:00:51.884795+0000","last_became_active":"2024-06-11T16:03:16.194759+0000","last_became_peered":"2024-06-11T16:03:16.194759+0000","last_unstale":"2024-06-11T16:03:17.180349+0000","last_undegraded":"2024-06-11T16:03:16.179951+0000","last_fullsized":"2024-06-11T16:03:16.178957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":97,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":45}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.184212+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:18.184212+0000","last_peered":"2024-06-11T16:03:18.184212+0000","last_clean":"2024-06-11T16:03:18.184212+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:18.184212+0000","last_undegraded":"2024-06-11T16:03:18.184212+0000","last_fullsized":"2024-06-11T16:03:18.184212+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178880+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:18.178880+0000","last_peered":"2024-06-11T16:03:18.178880+0000","last_clean":"2024-06-11T16:03:18.178880+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:18.178880+0000","last_undegraded":"2024-06-11T16:03:18.178880+0000","last_fullsized":"2024-06-11T16:03:18.178880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179354+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:18.179354+0000","last_peered":"2024-06-11T16:03:18.179354+0000","last_clean":"2024-06-11T16:03:18.179354+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:18.179354+0000","last_undegraded":"2024-06-11T16:03:18.179354+0000","last_fullsized":"2024-06-11T16:03:18.179354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179114+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:18.179114+0000","last_peered":"2024-06-11T16:03:18.179114+0000","last_clean":"2024-06-11T16:03:18.179114+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:18.179114+0000","last_undegraded":"2024-06-11T16:03:18.179114+0000","last_fullsized":"2024-06-11T16:03:18.179114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179955+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:18.179955+0000","last_peered":"2024-06-11T16:03:18.179955+0000","last_clean":"2024-06-11T16:03:18.179955+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:18.179955+0000","last_undegraded":"2024-06-11T16:03:18.179955+0000","last_fullsized":"2024-06-11T16:03:18.179955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":270,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.181198+0000","last_change":"2024-06-11T16:03:16.192499+0000","last_active":"2024-06-11T16:03:17.181198+0000","last_peered":"2024-06-11T16:03:17.181198+0000","last_clean":"2024-06-11T16:03:13.145765+0000","last_became_active":"2024-06-11T16:03:16.191847+0000","last_became_peered":"2024-06-11T16:03:16.191847+0000","last_unstale":"2024-06-11T16:03:17.181198+0000","last_undegraded":"2024-06-11T16:03:16.166138+0000","last_fullsized":"2024-06-11T16:03:16.164953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179537+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:18.179537+0000","last_peered":"2024-06-11T16:03:18.179537+0000","last_clean":"2024-06-11T16:03:18.179537+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:18.179537+0000","last_undegraded":"2024-06-11T16:03:18.179537+0000","last_fullsized":"2024-06-11T16:03:18.179537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":281,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179286+0000","last_change":"2024-06-11T16:03:16.188586+0000","last_active":"2024-06-11T16:03:17.179286+0000","last_peered":"2024-06-11T16:03:17.179286+0000","last_clean":"2024-06-11T16:03:13.144491+0000","last_became_active":"2024-06-11T16:03:16.187988+0000","last_became_peered":"2024-06-11T16:03:16.187988+0000","last_unstale":"2024-06-11T16:03:17.179286+0000","last_undegraded":"2024-06-11T16:03:16.165185+0000","last_fullsized":"2024-06-11T16:03:16.159943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":115,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":63}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178823+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:18.178823+0000","last_peered":"2024-06-11T16:03:18.178823+0000","last_clean":"2024-06-11T16:03:18.178823+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:18.178823+0000","last_undegraded":"2024-06-11T16:03:18.178823+0000","last_fullsized":"2024-06-11T16:03:18.178823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":267,"reported_epoch":84,"state":"active+recovering+undersized+remapped","last_fresh":"2024-06-11T16:03:18.128201+0000","last_change":"2024-06-11T16:03:18.071702+0000","last_active":"2024-06-11T16:03:18.128201+0000","last_peered":"2024-06-11T16:03:18.128201+0000","last_clean":"2024-06-11T16:00:54.881776+0000","last_became_active":"2024-06-11T16:03:16.191861+0000","last_became_peered":"2024-06-11T16:03:16.191861+0000","last_unstale":"2024-06-11T16:03:18.128201+0000","last_undegraded":"2024-06-11T16:03:18.128201+0000","last_fullsized":"2024-06-11T16:03:16.175219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":25864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":34},{"shards":"1","objects":24}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":224,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.440008+0000","last_change":"2024-06-11T16:03:19.078787+0000","last_active":"2024-06-11T16:03:19.078787+0000","last_peered":"2024-06-11T16:03:17.440008+0000","last_clean":"2024-06-11T16:03:12.135478+0000","last_became_active":"2024-06-11T16:03:16.184920+0000","last_became_peered":"2024-06-11T16:03:16.184920+0000","last_unstale":"2024-06-11T16:03:17.440008+0000","last_undegraded":"2024-06-11T16:03:17.440008+0000","last_fullsized":"2024-06-11T16:03:17.440008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":239,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.443714+0000","last_change":"2024-06-11T16:03:19.078630+0000","last_active":"2024-06-11T16:03:19.078630+0000","last_peered":"2024-06-11T16:03:17.443714+0000","last_clean":"2024-06-11T15:58:53.120953+0000","last_became_active":"2024-06-11T16:03:16.191135+0000","last_became_peered":"2024-06-11T16:03:16.191135+0000","last_unstale":"2024-06-11T16:03:17.443714+0000","last_undegraded":"2024-06-11T16:03:17.443714+0000","last_fullsized":"2024-06-11T16:03:16.164894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178783+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:18.178783+0000","last_peered":"2024-06-11T16:03:18.178783+0000","last_clean":"2024-06-11T16:03:18.178783+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:18.178783+0000","last_undegraded":"2024-06-11T16:03:18.178783+0000","last_fullsized":"2024-06-11T16:03:18.178783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":202,"reported_epoch":85,"state":"peering","last_fresh":"2024-06-11T16:03:17.948980+0000","last_change":"2024-06-11T16:03:19.078773+0000","last_active":"2024-06-11T16:03:19.078773+0000","last_peered":"2024-06-11T16:03:17.948980+0000","last_clean":"2024-06-11T16:00:54.882186+0000","last_became_active":"2024-06-11T16:03:16.191785+0000","last_became_peered":"2024-06-11T16:03:16.191785+0000","last_unstale":"2024-06-11T16:03:17.948980+0000","last_undegraded":"2024-06-11T16:03:17.948980+0000","last_fullsized":"2024-06-11T16:03:16.162689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179560+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:18.179560+0000","last_peered":"2024-06-11T16:03:18.179560+0000","last_clean":"2024-06-11T16:03:18.179560+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:18.179560+0000","last_undegraded":"2024-06-11T16:03:18.179560+0000","last_fullsized":"2024-06-11T16:03:18.179560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178739+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:18.178739+0000","last_peered":"2024-06-11T16:03:18.178739+0000","last_clean":"2024-06-11T16:03:18.178739+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:18.178739+0000","last_undegraded":"2024-06-11T16:03:18.178739+0000","last_fullsized":"2024-06-11T16:03:18.178739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178519+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:18.178519+0000","last_peered":"2024-06-11T16:03:18.178519+0000","last_clean":"2024-06-11T16:03:18.178519+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:18.178519+0000","last_undegraded":"2024-06-11T16:03:18.178519+0000","last_fullsized":"2024-06-11T16:03:18.178519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.180209+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:18.180209+0000","last_peered":"2024-06-11T16:03:18.180209+0000","last_clean":"2024-06-11T16:03:18.180209+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:18.180209+0000","last_undegraded":"2024-06-11T16:03:18.180209+0000","last_fullsized":"2024-06-11T16:03:18.180209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179070+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:18.179070+0000","last_peered":"2024-06-11T16:03:18.179070+0000","last_clean":"2024-06-11T16:03:18.179070+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:18.179070+0000","last_undegraded":"2024-06-11T16:03:18.179070+0000","last_fullsized":"2024-06-11T16:03:18.179070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":203,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.178020+0000","last_change":"2024-06-11T16:03:16.193145+0000","last_active":"2024-06-11T16:03:17.178020+0000","last_peered":"2024-06-11T16:03:17.178020+0000","last_clean":"2024-06-11T16:00:49.663987+0000","last_became_active":"2024-06-11T16:03:16.192482+0000","last_became_peered":"2024-06-11T16:03:16.192482+0000","last_unstale":"2024-06-11T16:03:17.178020+0000","last_undegraded":"2024-06-11T16:03:16.179441+0000","last_fullsized":"2024-06-11T16:03:16.178454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":62}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179630+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:18.179630+0000","last_peered":"2024-06-11T16:03:18.179630+0000","last_clean":"2024-06-11T16:03:18.179630+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:18.179630+0000","last_undegraded":"2024-06-11T16:03:18.179630+0000","last_fullsized":"2024-06-11T16:03:18.179630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.178653+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:18.178653+0000","last_peered":"2024-06-11T16:03:18.178653+0000","last_clean":"2024-06-11T16:03:18.178653+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:18.178653+0000","last_undegraded":"2024-06-11T16:03:18.178653+0000","last_fullsized":"2024-06-11T16:03:18.178653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":269,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.179186+0000","last_change":"2024-06-11T16:03:16.191650+0000","last_active":"2024-06-11T16:03:17.179186+0000","last_peered":"2024-06-11T16:03:17.179186+0000","last_clean":"2024-06-11T16:03:13.142283+0000","last_became_active":"2024-06-11T16:03:16.190729+0000","last_became_peered":"2024-06-11T16:03:16.190729+0000","last_unstale":"2024-06-11T16:03:17.179186+0000","last_undegraded":"2024-06-11T16:03:16.166117+0000","last_fullsized":"2024-06-11T16:03:16.164379+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":101,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":50}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179592+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:18.179592+0000","last_peered":"2024-06-11T16:03:18.179592+0000","last_clean":"2024-06-11T16:03:18.179592+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:18.179592+0000","last_undegraded":"2024-06-11T16:03:18.179592+0000","last_fullsized":"2024-06-11T16:03:18.179592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":267,"reported_epoch":84,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-06-11T16:03:17.180520+0000","last_change":"2024-06-11T16:03:16.192319+0000","last_active":"2024-06-11T16:03:17.180520+0000","last_peered":"2024-06-11T16:03:17.180520+0000","last_clean":"2024-06-11T16:03:13.145653+0000","last_became_active":"2024-06-11T16:03:16.191660+0000","last_became_peered":"2024-06-11T16:03:16.191660+0000","last_unstale":"2024-06-11T16:03:17.180520+0000","last_undegraded":"2024-06-11T16:03:16.167404+0000","last_fullsized":"2024-06-11T16:03:16.164859+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":56}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":297,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-06-11T16:03:18.179603+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:18.179603+0000","last_peered":"2024-06-11T16:03:18.179603+0000","last_clean":"2024-06-11T16:03:18.179603+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:18.179603+0000","last_undegraded":"2024-06-11T16:03:18.179603+0000","last_fullsized":"2024-06-11T16:03:18.179603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":708,"num_objects_misplaced":34,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3139,"num_bytes_recovered":10582608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62111744,"data_stored":51632617,"data_compressed":4324879,"data_compressed_allocated":5074944,"data_compressed_original":13295616,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":120,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678022,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49760,"kb_used_data":22224,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94322080,"statfs":{"total":96636764160,"available":96585809920,"internally_reserved":0,"allocated":22757376,"data_stored":48965737,"data_compressed":5999773,"data_compressed_allocated":7065600,"data_compressed_original":37867520,"omap_allocated":7164,"internal_metadata":28173316},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16699392,"data_stored":14404042,"data_compressed":1060691,"data_compressed_allocated":1253376,"data_compressed_original":3461120,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:27.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:27.689 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:27.690 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:27.700 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-06-11T16:03:27.647223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":236372,"kb_used_data":85420,"kb_used_omap":10,"kb_used_meta":150901,"kb_avail":282879148,"statfs":{"total":289910292480,"available":289668247552,"internally_reserved":0,"allocated":87470080,"data_stored":144538430,"data_compressed":17110009,"data_compressed_allocated":20217856,"data_compressed_original":99164160,"omap_allocated":10353,"internal_metadata":154523535},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1676,"num_objects_misplaced":-34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1758,"num_bytes_recovered":6806046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.504630"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145492+0000","last_change":"2024-06-11T16:03:19.141285+0000","last_active":"2024-06-11T16:03:23.145492+0000","last_peered":"2024-06-11T16:03:23.145492+0000","last_clean":"2024-06-11T16:03:23.145492+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:23.145492+0000","last_undegraded":"2024-06-11T16:03:23.145492+0000","last_fullsized":"2024-06-11T16:03:23.145492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:30:03.704426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145456+0000","last_change":"2024-06-11T16:03:19.140014+0000","last_active":"2024-06-11T16:03:23.145456+0000","last_peered":"2024-06-11T16:03:23.145456+0000","last_clean":"2024-06-11T16:03:23.145456+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:23.145456+0000","last_undegraded":"2024-06-11T16:03:23.145456+0000","last_fullsized":"2024-06-11T16:03:23.145456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:27:46.785658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145732+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:23.145732+0000","last_peered":"2024-06-11T16:03:23.145732+0000","last_clean":"2024-06-11T16:03:23.145732+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:23.145732+0000","last_undegraded":"2024-06-11T16:03:23.145732+0000","last_fullsized":"2024-06-11T16:03:23.145732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145006+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:23.145006+0000","last_peered":"2024-06-11T16:03:23.145006+0000","last_clean":"2024-06-11T16:03:23.145006+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:23.145006+0000","last_undegraded":"2024-06-11T16:03:23.145006+0000","last_fullsized":"2024-06-11T16:03:23.145006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":246,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144939+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:23.144939+0000","last_peered":"2024-06-11T16:03:23.144939+0000","last_clean":"2024-06-11T16:03:23.144939+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:23.144939+0000","last_undegraded":"2024-06-11T16:03:23.144939+0000","last_fullsized":"2024-06-11T16:03:23.144939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:12:32.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146420+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146420+0000","last_peered":"2024-06-11T16:03:23.146420+0000","last_clean":"2024-06-11T16:03:23.146420+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146420+0000","last_undegraded":"2024-06-11T16:03:23.146420+0000","last_fullsized":"2024-06-11T16:03:23.146420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146455+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:23.146455+0000","last_peered":"2024-06-11T16:03:23.146455+0000","last_clean":"2024-06-11T16:03:23.146455+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:23.146455+0000","last_undegraded":"2024-06-11T16:03:23.146455+0000","last_fullsized":"2024-06-11T16:03:23.146455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145265+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:23.145265+0000","last_peered":"2024-06-11T16:03:23.145265+0000","last_clean":"2024-06-11T16:03:23.145265+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:23.145265+0000","last_undegraded":"2024-06-11T16:03:23.145265+0000","last_fullsized":"2024-06-11T16:03:23.145265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":282,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145987+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.145987+0000","last_peered":"2024-06-11T16:03:23.145987+0000","last_clean":"2024-06-11T16:03:23.145987+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.145987+0000","last_undegraded":"2024-06-11T16:03:23.145987+0000","last_fullsized":"2024-06-11T16:03:23.145987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":276,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146241+0000","last_change":"2024-06-11T16:03:19.139021+0000","last_active":"2024-06-11T16:03:23.146241+0000","last_peered":"2024-06-11T16:03:23.146241+0000","last_clean":"2024-06-11T16:03:23.146241+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:23.146241+0000","last_undegraded":"2024-06-11T16:03:23.146241+0000","last_fullsized":"2024-06-11T16:03:23.146241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:04.174761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154833+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:23.154833+0000","last_peered":"2024-06-11T16:03:23.154833+0000","last_clean":"2024-06-11T16:03:23.154833+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:23.154833+0000","last_undegraded":"2024-06-11T16:03:23.154833+0000","last_fullsized":"2024-06-11T16:03:23.154833+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:18:18.583852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144947+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.144947+0000","last_peered":"2024-06-11T16:03:23.144947+0000","last_clean":"2024-06-11T16:03:23.144947+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.144947+0000","last_undegraded":"2024-06-11T16:03:23.144947+0000","last_fullsized":"2024-06-11T16:03:23.144947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146373+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:23.146373+0000","last_peered":"2024-06-11T16:03:23.146373+0000","last_clean":"2024-06-11T16:03:23.146373+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:23.146373+0000","last_undegraded":"2024-06-11T16:03:23.146373+0000","last_fullsized":"2024-06-11T16:03:23.146373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145000+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:23.145000+0000","last_peered":"2024-06-11T16:03:23.145000+0000","last_clean":"2024-06-11T16:03:23.145000+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:23.145000+0000","last_undegraded":"2024-06-11T16:03:23.145000+0000","last_fullsized":"2024-06-11T16:03:23.145000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145743+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145743+0000","last_peered":"2024-06-11T16:03:23.145743+0000","last_clean":"2024-06-11T16:03:23.145743+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145743+0000","last_undegraded":"2024-06-11T16:03:23.145743+0000","last_fullsized":"2024-06-11T16:03:23.145743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146007+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:23.146007+0000","last_peered":"2024-06-11T16:03:23.146007+0000","last_clean":"2024-06-11T16:03:23.146007+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:23.146007+0000","last_undegraded":"2024-06-11T16:03:23.146007+0000","last_fullsized":"2024-06-11T16:03:23.146007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154797+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:23.154797+0000","last_peered":"2024-06-11T16:03:23.154797+0000","last_clean":"2024-06-11T16:03:23.154797+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:23.154797+0000","last_undegraded":"2024-06-11T16:03:23.154797+0000","last_fullsized":"2024-06-11T16:03:23.154797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:47:50.845754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145570+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145570+0000","last_peered":"2024-06-11T16:03:23.145570+0000","last_clean":"2024-06-11T16:03:23.145570+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145570+0000","last_undegraded":"2024-06-11T16:03:23.145570+0000","last_fullsized":"2024-06-11T16:03:23.145570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145391+0000","last_change":"2024-06-11T16:03:20.143760+0000","last_active":"2024-06-11T16:03:23.145391+0000","last_peered":"2024-06-11T16:03:23.145391+0000","last_clean":"2024-06-11T16:03:23.145391+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:23.145391+0000","last_undegraded":"2024-06-11T16:03:23.145391+0000","last_fullsized":"2024-06-11T16:03:23.145391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:28.257417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146275+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146275+0000","last_peered":"2024-06-11T16:03:23.146275+0000","last_clean":"2024-06-11T16:03:23.146275+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146275+0000","last_undegraded":"2024-06-11T16:03:23.146275+0000","last_fullsized":"2024-06-11T16:03:23.146275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146312+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:23.146312+0000","last_peered":"2024-06-11T16:03:23.146312+0000","last_clean":"2024-06-11T16:03:23.146312+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:23.146312+0000","last_undegraded":"2024-06-11T16:03:23.146312+0000","last_fullsized":"2024-06-11T16:03:23.146312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:18.597916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":240,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145768+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145768+0000","last_peered":"2024-06-11T16:03:23.145768+0000","last_clean":"2024-06-11T16:03:23.145768+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145768+0000","last_undegraded":"2024-06-11T16:03:23.145768+0000","last_fullsized":"2024-06-11T16:03:23.145768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:11.936266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144819+0000","last_change":"2024-06-11T16:03:19.139291+0000","last_active":"2024-06-11T16:03:23.144819+0000","last_peered":"2024-06-11T16:03:23.144819+0000","last_clean":"2024-06-11T16:03:23.144819+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:23.144819+0000","last_undegraded":"2024-06-11T16:03:23.144819+0000","last_fullsized":"2024-06-11T16:03:23.144819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:00.383856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146093+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146093+0000","last_peered":"2024-06-11T16:03:23.146093+0000","last_clean":"2024-06-11T16:03:23.146093+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146093+0000","last_undegraded":"2024-06-11T16:03:23.146093+0000","last_fullsized":"2024-06-11T16:03:23.146093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145829+0000","last_change":"2024-06-11T16:03:19.141284+0000","last_active":"2024-06-11T16:03:23.145829+0000","last_peered":"2024-06-11T16:03:23.145829+0000","last_clean":"2024-06-11T16:03:23.145829+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:23.145829+0000","last_undegraded":"2024-06-11T16:03:23.145829+0000","last_fullsized":"2024-06-11T16:03:23.145829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:27:19.294972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145144+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:23.145144+0000","last_peered":"2024-06-11T16:03:23.145144+0000","last_clean":"2024-06-11T16:03:23.145144+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:23.145144+0000","last_undegraded":"2024-06-11T16:03:23.145144+0000","last_fullsized":"2024-06-11T16:03:23.145144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146173+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146173+0000","last_peered":"2024-06-11T16:03:23.146173+0000","last_clean":"2024-06-11T16:03:23.146173+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146173+0000","last_undegraded":"2024-06-11T16:03:23.146173+0000","last_fullsized":"2024-06-11T16:03:23.146173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145928+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:23.145928+0000","last_peered":"2024-06-11T16:03:23.145928+0000","last_clean":"2024-06-11T16:03:23.145928+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:23.145928+0000","last_undegraded":"2024-06-11T16:03:23.145928+0000","last_fullsized":"2024-06-11T16:03:23.145928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146132+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146132+0000","last_peered":"2024-06-11T16:03:23.146132+0000","last_clean":"2024-06-11T16:03:23.146132+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146132+0000","last_undegraded":"2024-06-11T16:03:23.146132+0000","last_fullsized":"2024-06-11T16:03:23.146132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145676+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145676+0000","last_peered":"2024-06-11T16:03:23.145676+0000","last_clean":"2024-06-11T16:03:23.145676+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145676+0000","last_undegraded":"2024-06-11T16:03:23.145676+0000","last_fullsized":"2024-06-11T16:03:23.145676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":211,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145243+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:23.145243+0000","last_peered":"2024-06-11T16:03:23.145243+0000","last_clean":"2024-06-11T16:03:23.145243+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:23.145243+0000","last_undegraded":"2024-06-11T16:03:23.145243+0000","last_fullsized":"2024-06-11T16:03:23.145243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:32:07.842170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145702+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:23.145702+0000","last_peered":"2024-06-11T16:03:23.145702+0000","last_clean":"2024-06-11T16:03:23.145702+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:23.145702+0000","last_undegraded":"2024-06-11T16:03:23.145702+0000","last_fullsized":"2024-06-11T16:03:23.145702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145721+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:23.145721+0000","last_peered":"2024-06-11T16:03:23.145721+0000","last_clean":"2024-06-11T16:03:23.145721+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:23.145721+0000","last_undegraded":"2024-06-11T16:03:23.145721+0000","last_fullsized":"2024-06-11T16:03:23.145721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154860+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:23.154860+0000","last_peered":"2024-06-11T16:03:23.154860+0000","last_clean":"2024-06-11T16:03:23.154860+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:23.154860+0000","last_undegraded":"2024-06-11T16:03:23.154860+0000","last_fullsized":"2024-06-11T16:03:23.154860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:08.358516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145595+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:23.145595+0000","last_peered":"2024-06-11T16:03:23.145595+0000","last_clean":"2024-06-11T16:03:23.145595+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:23.145595+0000","last_undegraded":"2024-06-11T16:03:23.145595+0000","last_fullsized":"2024-06-11T16:03:23.145595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.155216+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:23.155216+0000","last_peered":"2024-06-11T16:03:23.155216+0000","last_clean":"2024-06-11T16:03:23.155216+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:23.155216+0000","last_undegraded":"2024-06-11T16:03:23.155216+0000","last_fullsized":"2024-06-11T16:03:23.155216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:47.274422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145150+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145150+0000","last_peered":"2024-06-11T16:03:23.145150+0000","last_clean":"2024-06-11T16:03:23.145150+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145150+0000","last_undegraded":"2024-06-11T16:03:23.145150+0000","last_fullsized":"2024-06-11T16:03:23.145150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69144576,"data_stored":57387655,"data_compressed":4634117,"data_compressed_allocated":5435392,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65548,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":35833,"kb_avail":94306292,"statfs":{"total":96636764160,"available":96569643008,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":36692996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:27.704 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-06-11T16:03:27.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-06-11T16:03:28.043 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-11T16:03:28.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-11T16:03:28.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:28.349 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:28.350 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:28.360 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-06-11T16:03:27.647223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":236372,"kb_used_data":85420,"kb_used_omap":10,"kb_used_meta":150901,"kb_avail":282879148,"statfs":{"total":289910292480,"available":289668247552,"internally_reserved":0,"allocated":87470080,"data_stored":144538430,"data_compressed":17110009,"data_compressed_allocated":20217856,"data_compressed_original":99164160,"omap_allocated":10353,"internal_metadata":154523535},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1676,"num_objects_misplaced":-34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1758,"num_bytes_recovered":6806046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.504630"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145492+0000","last_change":"2024-06-11T16:03:19.141285+0000","last_active":"2024-06-11T16:03:23.145492+0000","last_peered":"2024-06-11T16:03:23.145492+0000","last_clean":"2024-06-11T16:03:23.145492+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:23.145492+0000","last_undegraded":"2024-06-11T16:03:23.145492+0000","last_fullsized":"2024-06-11T16:03:23.145492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:30:03.704426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145456+0000","last_change":"2024-06-11T16:03:19.140014+0000","last_active":"2024-06-11T16:03:23.145456+0000","last_peered":"2024-06-11T16:03:23.145456+0000","last_clean":"2024-06-11T16:03:23.145456+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:23.145456+0000","last_undegraded":"2024-06-11T16:03:23.145456+0000","last_fullsized":"2024-06-11T16:03:23.145456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:27:46.785658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145732+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:23.145732+0000","last_peered":"2024-06-11T16:03:23.145732+0000","last_clean":"2024-06-11T16:03:23.145732+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:23.145732+0000","last_undegraded":"2024-06-11T16:03:23.145732+0000","last_fullsized":"2024-06-11T16:03:23.145732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145006+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:23.145006+0000","last_peered":"2024-06-11T16:03:23.145006+0000","last_clean":"2024-06-11T16:03:23.145006+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:23.145006+0000","last_undegraded":"2024-06-11T16:03:23.145006+0000","last_fullsized":"2024-06-11T16:03:23.145006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":246,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144939+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:23.144939+0000","last_peered":"2024-06-11T16:03:23.144939+0000","last_clean":"2024-06-11T16:03:23.144939+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:23.144939+0000","last_undegraded":"2024-06-11T16:03:23.144939+0000","last_fullsized":"2024-06-11T16:03:23.144939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:12:32.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146420+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146420+0000","last_peered":"2024-06-11T16:03:23.146420+0000","last_clean":"2024-06-11T16:03:23.146420+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146420+0000","last_undegraded":"2024-06-11T16:03:23.146420+0000","last_fullsized":"2024-06-11T16:03:23.146420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146455+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:23.146455+0000","last_peered":"2024-06-11T16:03:23.146455+0000","last_clean":"2024-06-11T16:03:23.146455+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:23.146455+0000","last_undegraded":"2024-06-11T16:03:23.146455+0000","last_fullsized":"2024-06-11T16:03:23.146455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145265+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:23.145265+0000","last_peered":"2024-06-11T16:03:23.145265+0000","last_clean":"2024-06-11T16:03:23.145265+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:23.145265+0000","last_undegraded":"2024-06-11T16:03:23.145265+0000","last_fullsized":"2024-06-11T16:03:23.145265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":282,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145987+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.145987+0000","last_peered":"2024-06-11T16:03:23.145987+0000","last_clean":"2024-06-11T16:03:23.145987+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.145987+0000","last_undegraded":"2024-06-11T16:03:23.145987+0000","last_fullsized":"2024-06-11T16:03:23.145987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":276,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146241+0000","last_change":"2024-06-11T16:03:19.139021+0000","last_active":"2024-06-11T16:03:23.146241+0000","last_peered":"2024-06-11T16:03:23.146241+0000","last_clean":"2024-06-11T16:03:23.146241+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:23.146241+0000","last_undegraded":"2024-06-11T16:03:23.146241+0000","last_fullsized":"2024-06-11T16:03:23.146241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:04.174761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154833+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:23.154833+0000","last_peered":"2024-06-11T16:03:23.154833+0000","last_clean":"2024-06-11T16:03:23.154833+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:23.154833+0000","last_undegraded":"2024-06-11T16:03:23.154833+0000","last_fullsized":"2024-06-11T16:03:23.154833+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:18:18.583852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144947+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.144947+0000","last_peered":"2024-06-11T16:03:23.144947+0000","last_clean":"2024-06-11T16:03:23.144947+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.144947+0000","last_undegraded":"2024-06-11T16:03:23.144947+0000","last_fullsized":"2024-06-11T16:03:23.144947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146373+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:23.146373+0000","last_peered":"2024-06-11T16:03:23.146373+0000","last_clean":"2024-06-11T16:03:23.146373+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:23.146373+0000","last_undegraded":"2024-06-11T16:03:23.146373+0000","last_fullsized":"2024-06-11T16:03:23.146373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145000+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:23.145000+0000","last_peered":"2024-06-11T16:03:23.145000+0000","last_clean":"2024-06-11T16:03:23.145000+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:23.145000+0000","last_undegraded":"2024-06-11T16:03:23.145000+0000","last_fullsized":"2024-06-11T16:03:23.145000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145743+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145743+0000","last_peered":"2024-06-11T16:03:23.145743+0000","last_clean":"2024-06-11T16:03:23.145743+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145743+0000","last_undegraded":"2024-06-11T16:03:23.145743+0000","last_fullsized":"2024-06-11T16:03:23.145743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146007+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:23.146007+0000","last_peered":"2024-06-11T16:03:23.146007+0000","last_clean":"2024-06-11T16:03:23.146007+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:23.146007+0000","last_undegraded":"2024-06-11T16:03:23.146007+0000","last_fullsized":"2024-06-11T16:03:23.146007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154797+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:23.154797+0000","last_peered":"2024-06-11T16:03:23.154797+0000","last_clean":"2024-06-11T16:03:23.154797+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:23.154797+0000","last_undegraded":"2024-06-11T16:03:23.154797+0000","last_fullsized":"2024-06-11T16:03:23.154797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:47:50.845754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145570+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145570+0000","last_peered":"2024-06-11T16:03:23.145570+0000","last_clean":"2024-06-11T16:03:23.145570+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145570+0000","last_undegraded":"2024-06-11T16:03:23.145570+0000","last_fullsized":"2024-06-11T16:03:23.145570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145391+0000","last_change":"2024-06-11T16:03:20.143760+0000","last_active":"2024-06-11T16:03:23.145391+0000","last_peered":"2024-06-11T16:03:23.145391+0000","last_clean":"2024-06-11T16:03:23.145391+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:23.145391+0000","last_undegraded":"2024-06-11T16:03:23.145391+0000","last_fullsized":"2024-06-11T16:03:23.145391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:28.257417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146275+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146275+0000","last_peered":"2024-06-11T16:03:23.146275+0000","last_clean":"2024-06-11T16:03:23.146275+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146275+0000","last_undegraded":"2024-06-11T16:03:23.146275+0000","last_fullsized":"2024-06-11T16:03:23.146275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146312+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:23.146312+0000","last_peered":"2024-06-11T16:03:23.146312+0000","last_clean":"2024-06-11T16:03:23.146312+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:23.146312+0000","last_undegraded":"2024-06-11T16:03:23.146312+0000","last_fullsized":"2024-06-11T16:03:23.146312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:18.597916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":240,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145768+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145768+0000","last_peered":"2024-06-11T16:03:23.145768+0000","last_clean":"2024-06-11T16:03:23.145768+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145768+0000","last_undegraded":"2024-06-11T16:03:23.145768+0000","last_fullsized":"2024-06-11T16:03:23.145768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:11.936266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144819+0000","last_change":"2024-06-11T16:03:19.139291+0000","last_active":"2024-06-11T16:03:23.144819+0000","last_peered":"2024-06-11T16:03:23.144819+0000","last_clean":"2024-06-11T16:03:23.144819+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:23.144819+0000","last_undegraded":"2024-06-11T16:03:23.144819+0000","last_fullsized":"2024-06-11T16:03:23.144819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:00.383856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146093+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146093+0000","last_peered":"2024-06-11T16:03:23.146093+0000","last_clean":"2024-06-11T16:03:23.146093+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146093+0000","last_undegraded":"2024-06-11T16:03:23.146093+0000","last_fullsized":"2024-06-11T16:03:23.146093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145829+0000","last_change":"2024-06-11T16:03:19.141284+0000","last_active":"2024-06-11T16:03:23.145829+0000","last_peered":"2024-06-11T16:03:23.145829+0000","last_clean":"2024-06-11T16:03:23.145829+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:23.145829+0000","last_undegraded":"2024-06-11T16:03:23.145829+0000","last_fullsized":"2024-06-11T16:03:23.145829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:27:19.294972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145144+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:23.145144+0000","last_peered":"2024-06-11T16:03:23.145144+0000","last_clean":"2024-06-11T16:03:23.145144+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:23.145144+0000","last_undegraded":"2024-06-11T16:03:23.145144+0000","last_fullsized":"2024-06-11T16:03:23.145144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146173+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146173+0000","last_peered":"2024-06-11T16:03:23.146173+0000","last_clean":"2024-06-11T16:03:23.146173+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146173+0000","last_undegraded":"2024-06-11T16:03:23.146173+0000","last_fullsized":"2024-06-11T16:03:23.146173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145928+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:23.145928+0000","last_peered":"2024-06-11T16:03:23.145928+0000","last_clean":"2024-06-11T16:03:23.145928+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:23.145928+0000","last_undegraded":"2024-06-11T16:03:23.145928+0000","last_fullsized":"2024-06-11T16:03:23.145928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146132+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146132+0000","last_peered":"2024-06-11T16:03:23.146132+0000","last_clean":"2024-06-11T16:03:23.146132+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146132+0000","last_undegraded":"2024-06-11T16:03:23.146132+0000","last_fullsized":"2024-06-11T16:03:23.146132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145676+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145676+0000","last_peered":"2024-06-11T16:03:23.145676+0000","last_clean":"2024-06-11T16:03:23.145676+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145676+0000","last_undegraded":"2024-06-11T16:03:23.145676+0000","last_fullsized":"2024-06-11T16:03:23.145676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":211,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145243+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:23.145243+0000","last_peered":"2024-06-11T16:03:23.145243+0000","last_clean":"2024-06-11T16:03:23.145243+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:23.145243+0000","last_undegraded":"2024-06-11T16:03:23.145243+0000","last_fullsized":"2024-06-11T16:03:23.145243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:32:07.842170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145702+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:23.145702+0000","last_peered":"2024-06-11T16:03:23.145702+0000","last_clean":"2024-06-11T16:03:23.145702+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:23.145702+0000","last_undegraded":"2024-06-11T16:03:23.145702+0000","last_fullsized":"2024-06-11T16:03:23.145702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145721+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:23.145721+0000","last_peered":"2024-06-11T16:03:23.145721+0000","last_clean":"2024-06-11T16:03:23.145721+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:23.145721+0000","last_undegraded":"2024-06-11T16:03:23.145721+0000","last_fullsized":"2024-06-11T16:03:23.145721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154860+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:23.154860+0000","last_peered":"2024-06-11T16:03:23.154860+0000","last_clean":"2024-06-11T16:03:23.154860+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:23.154860+0000","last_undegraded":"2024-06-11T16:03:23.154860+0000","last_fullsized":"2024-06-11T16:03:23.154860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:08.358516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145595+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:23.145595+0000","last_peered":"2024-06-11T16:03:23.145595+0000","last_clean":"2024-06-11T16:03:23.145595+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:23.145595+0000","last_undegraded":"2024-06-11T16:03:23.145595+0000","last_fullsized":"2024-06-11T16:03:23.145595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.155216+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:23.155216+0000","last_peered":"2024-06-11T16:03:23.155216+0000","last_clean":"2024-06-11T16:03:23.155216+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:23.155216+0000","last_undegraded":"2024-06-11T16:03:23.155216+0000","last_fullsized":"2024-06-11T16:03:23.155216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:47.274422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145150+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145150+0000","last_peered":"2024-06-11T16:03:23.145150+0000","last_clean":"2024-06-11T16:03:23.145150+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145150+0000","last_undegraded":"2024-06-11T16:03:23.145150+0000","last_fullsized":"2024-06-11T16:03:23.145150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69144576,"data_stored":57387655,"data_compressed":4634117,"data_compressed_allocated":5435392,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65548,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":35833,"kb_avail":94306292,"statfs":{"total":96636764160,"available":96569643008,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":36692996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:28.364 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:28.689 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:28.701 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-06-11T16:03:27.647223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":236372,"kb_used_data":85420,"kb_used_omap":10,"kb_used_meta":150901,"kb_avail":282879148,"statfs":{"total":289910292480,"available":289668247552,"internally_reserved":0,"allocated":87470080,"data_stored":144538430,"data_compressed":17110009,"data_compressed_allocated":20217856,"data_compressed_original":99164160,"omap_allocated":10353,"internal_metadata":154523535},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1676,"num_objects_misplaced":-34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1758,"num_bytes_recovered":6806046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.504630"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145492+0000","last_change":"2024-06-11T16:03:19.141285+0000","last_active":"2024-06-11T16:03:23.145492+0000","last_peered":"2024-06-11T16:03:23.145492+0000","last_clean":"2024-06-11T16:03:23.145492+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:23.145492+0000","last_undegraded":"2024-06-11T16:03:23.145492+0000","last_fullsized":"2024-06-11T16:03:23.145492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:30:03.704426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145456+0000","last_change":"2024-06-11T16:03:19.140014+0000","last_active":"2024-06-11T16:03:23.145456+0000","last_peered":"2024-06-11T16:03:23.145456+0000","last_clean":"2024-06-11T16:03:23.145456+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:23.145456+0000","last_undegraded":"2024-06-11T16:03:23.145456+0000","last_fullsized":"2024-06-11T16:03:23.145456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:27:46.785658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145732+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:23.145732+0000","last_peered":"2024-06-11T16:03:23.145732+0000","last_clean":"2024-06-11T16:03:23.145732+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:23.145732+0000","last_undegraded":"2024-06-11T16:03:23.145732+0000","last_fullsized":"2024-06-11T16:03:23.145732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145006+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:23.145006+0000","last_peered":"2024-06-11T16:03:23.145006+0000","last_clean":"2024-06-11T16:03:23.145006+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:23.145006+0000","last_undegraded":"2024-06-11T16:03:23.145006+0000","last_fullsized":"2024-06-11T16:03:23.145006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":246,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144939+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:23.144939+0000","last_peered":"2024-06-11T16:03:23.144939+0000","last_clean":"2024-06-11T16:03:23.144939+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:23.144939+0000","last_undegraded":"2024-06-11T16:03:23.144939+0000","last_fullsized":"2024-06-11T16:03:23.144939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:12:32.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146420+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146420+0000","last_peered":"2024-06-11T16:03:23.146420+0000","last_clean":"2024-06-11T16:03:23.146420+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146420+0000","last_undegraded":"2024-06-11T16:03:23.146420+0000","last_fullsized":"2024-06-11T16:03:23.146420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146455+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:23.146455+0000","last_peered":"2024-06-11T16:03:23.146455+0000","last_clean":"2024-06-11T16:03:23.146455+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:23.146455+0000","last_undegraded":"2024-06-11T16:03:23.146455+0000","last_fullsized":"2024-06-11T16:03:23.146455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145265+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:23.145265+0000","last_peered":"2024-06-11T16:03:23.145265+0000","last_clean":"2024-06-11T16:03:23.145265+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:23.145265+0000","last_undegraded":"2024-06-11T16:03:23.145265+0000","last_fullsized":"2024-06-11T16:03:23.145265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":282,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145987+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.145987+0000","last_peered":"2024-06-11T16:03:23.145987+0000","last_clean":"2024-06-11T16:03:23.145987+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.145987+0000","last_undegraded":"2024-06-11T16:03:23.145987+0000","last_fullsized":"2024-06-11T16:03:23.145987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":276,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146241+0000","last_change":"2024-06-11T16:03:19.139021+0000","last_active":"2024-06-11T16:03:23.146241+0000","last_peered":"2024-06-11T16:03:23.146241+0000","last_clean":"2024-06-11T16:03:23.146241+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:23.146241+0000","last_undegraded":"2024-06-11T16:03:23.146241+0000","last_fullsized":"2024-06-11T16:03:23.146241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:04.174761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154833+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:23.154833+0000","last_peered":"2024-06-11T16:03:23.154833+0000","last_clean":"2024-06-11T16:03:23.154833+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:23.154833+0000","last_undegraded":"2024-06-11T16:03:23.154833+0000","last_fullsized":"2024-06-11T16:03:23.154833+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:18:18.583852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144947+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.144947+0000","last_peered":"2024-06-11T16:03:23.144947+0000","last_clean":"2024-06-11T16:03:23.144947+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.144947+0000","last_undegraded":"2024-06-11T16:03:23.144947+0000","last_fullsized":"2024-06-11T16:03:23.144947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146373+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:23.146373+0000","last_peered":"2024-06-11T16:03:23.146373+0000","last_clean":"2024-06-11T16:03:23.146373+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:23.146373+0000","last_undegraded":"2024-06-11T16:03:23.146373+0000","last_fullsized":"2024-06-11T16:03:23.146373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145000+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:23.145000+0000","last_peered":"2024-06-11T16:03:23.145000+0000","last_clean":"2024-06-11T16:03:23.145000+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:23.145000+0000","last_undegraded":"2024-06-11T16:03:23.145000+0000","last_fullsized":"2024-06-11T16:03:23.145000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145743+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145743+0000","last_peered":"2024-06-11T16:03:23.145743+0000","last_clean":"2024-06-11T16:03:23.145743+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145743+0000","last_undegraded":"2024-06-11T16:03:23.145743+0000","last_fullsized":"2024-06-11T16:03:23.145743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146007+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:23.146007+0000","last_peered":"2024-06-11T16:03:23.146007+0000","last_clean":"2024-06-11T16:03:23.146007+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:23.146007+0000","last_undegraded":"2024-06-11T16:03:23.146007+0000","last_fullsized":"2024-06-11T16:03:23.146007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154797+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:23.154797+0000","last_peered":"2024-06-11T16:03:23.154797+0000","last_clean":"2024-06-11T16:03:23.154797+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:23.154797+0000","last_undegraded":"2024-06-11T16:03:23.154797+0000","last_fullsized":"2024-06-11T16:03:23.154797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:47:50.845754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145570+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145570+0000","last_peered":"2024-06-11T16:03:23.145570+0000","last_clean":"2024-06-11T16:03:23.145570+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145570+0000","last_undegraded":"2024-06-11T16:03:23.145570+0000","last_fullsized":"2024-06-11T16:03:23.145570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145391+0000","last_change":"2024-06-11T16:03:20.143760+0000","last_active":"2024-06-11T16:03:23.145391+0000","last_peered":"2024-06-11T16:03:23.145391+0000","last_clean":"2024-06-11T16:03:23.145391+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:23.145391+0000","last_undegraded":"2024-06-11T16:03:23.145391+0000","last_fullsized":"2024-06-11T16:03:23.145391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:28.257417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146275+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146275+0000","last_peered":"2024-06-11T16:03:23.146275+0000","last_clean":"2024-06-11T16:03:23.146275+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146275+0000","last_undegraded":"2024-06-11T16:03:23.146275+0000","last_fullsized":"2024-06-11T16:03:23.146275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146312+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:23.146312+0000","last_peered":"2024-06-11T16:03:23.146312+0000","last_clean":"2024-06-11T16:03:23.146312+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:23.146312+0000","last_undegraded":"2024-06-11T16:03:23.146312+0000","last_fullsized":"2024-06-11T16:03:23.146312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:18.597916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":240,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145768+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145768+0000","last_peered":"2024-06-11T16:03:23.145768+0000","last_clean":"2024-06-11T16:03:23.145768+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145768+0000","last_undegraded":"2024-06-11T16:03:23.145768+0000","last_fullsized":"2024-06-11T16:03:23.145768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:11.936266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144819+0000","last_change":"2024-06-11T16:03:19.139291+0000","last_active":"2024-06-11T16:03:23.144819+0000","last_peered":"2024-06-11T16:03:23.144819+0000","last_clean":"2024-06-11T16:03:23.144819+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:23.144819+0000","last_undegraded":"2024-06-11T16:03:23.144819+0000","last_fullsized":"2024-06-11T16:03:23.144819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:00.383856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146093+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146093+0000","last_peered":"2024-06-11T16:03:23.146093+0000","last_clean":"2024-06-11T16:03:23.146093+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146093+0000","last_undegraded":"2024-06-11T16:03:23.146093+0000","last_fullsized":"2024-06-11T16:03:23.146093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145829+0000","last_change":"2024-06-11T16:03:19.141284+0000","last_active":"2024-06-11T16:03:23.145829+0000","last_peered":"2024-06-11T16:03:23.145829+0000","last_clean":"2024-06-11T16:03:23.145829+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:23.145829+0000","last_undegraded":"2024-06-11T16:03:23.145829+0000","last_fullsized":"2024-06-11T16:03:23.145829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:27:19.294972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145144+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:23.145144+0000","last_peered":"2024-06-11T16:03:23.145144+0000","last_clean":"2024-06-11T16:03:23.145144+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:23.145144+0000","last_undegraded":"2024-06-11T16:03:23.145144+0000","last_fullsized":"2024-06-11T16:03:23.145144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146173+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146173+0000","last_peered":"2024-06-11T16:03:23.146173+0000","last_clean":"2024-06-11T16:03:23.146173+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146173+0000","last_undegraded":"2024-06-11T16:03:23.146173+0000","last_fullsized":"2024-06-11T16:03:23.146173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145928+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:23.145928+0000","last_peered":"2024-06-11T16:03:23.145928+0000","last_clean":"2024-06-11T16:03:23.145928+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:23.145928+0000","last_undegraded":"2024-06-11T16:03:23.145928+0000","last_fullsized":"2024-06-11T16:03:23.145928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146132+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146132+0000","last_peered":"2024-06-11T16:03:23.146132+0000","last_clean":"2024-06-11T16:03:23.146132+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146132+0000","last_undegraded":"2024-06-11T16:03:23.146132+0000","last_fullsized":"2024-06-11T16:03:23.146132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145676+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145676+0000","last_peered":"2024-06-11T16:03:23.145676+0000","last_clean":"2024-06-11T16:03:23.145676+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145676+0000","last_undegraded":"2024-06-11T16:03:23.145676+0000","last_fullsized":"2024-06-11T16:03:23.145676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":211,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145243+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:23.145243+0000","last_peered":"2024-06-11T16:03:23.145243+0000","last_clean":"2024-06-11T16:03:23.145243+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:23.145243+0000","last_undegraded":"2024-06-11T16:03:23.145243+0000","last_fullsized":"2024-06-11T16:03:23.145243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:32:07.842170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145702+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:23.145702+0000","last_peered":"2024-06-11T16:03:23.145702+0000","last_clean":"2024-06-11T16:03:23.145702+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:23.145702+0000","last_undegraded":"2024-06-11T16:03:23.145702+0000","last_fullsized":"2024-06-11T16:03:23.145702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145721+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:23.145721+0000","last_peered":"2024-06-11T16:03:23.145721+0000","last_clean":"2024-06-11T16:03:23.145721+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:23.145721+0000","last_undegraded":"2024-06-11T16:03:23.145721+0000","last_fullsized":"2024-06-11T16:03:23.145721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154860+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:23.154860+0000","last_peered":"2024-06-11T16:03:23.154860+0000","last_clean":"2024-06-11T16:03:23.154860+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:23.154860+0000","last_undegraded":"2024-06-11T16:03:23.154860+0000","last_fullsized":"2024-06-11T16:03:23.154860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:08.358516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145595+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:23.145595+0000","last_peered":"2024-06-11T16:03:23.145595+0000","last_clean":"2024-06-11T16:03:23.145595+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:23.145595+0000","last_undegraded":"2024-06-11T16:03:23.145595+0000","last_fullsized":"2024-06-11T16:03:23.145595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.155216+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:23.155216+0000","last_peered":"2024-06-11T16:03:23.155216+0000","last_clean":"2024-06-11T16:03:23.155216+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:23.155216+0000","last_undegraded":"2024-06-11T16:03:23.155216+0000","last_fullsized":"2024-06-11T16:03:23.155216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:47.274422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145150+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145150+0000","last_peered":"2024-06-11T16:03:23.145150+0000","last_clean":"2024-06-11T16:03:23.145150+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145150+0000","last_undegraded":"2024-06-11T16:03:23.145150+0000","last_fullsized":"2024-06-11T16:03:23.145150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69144576,"data_stored":57387655,"data_compressed":4634117,"data_compressed_allocated":5435392,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65548,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":35833,"kb_avail":94306292,"statfs":{"total":96636764160,"available":96569643008,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":36692996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:28.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-11T16:03:28.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:29.032 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:29.033 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:29.043 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-06-11T16:03:27.647223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":236372,"kb_used_data":85420,"kb_used_omap":10,"kb_used_meta":150901,"kb_avail":282879148,"statfs":{"total":289910292480,"available":289668247552,"internally_reserved":0,"allocated":87470080,"data_stored":144538430,"data_compressed":17110009,"data_compressed_allocated":20217856,"data_compressed_original":99164160,"omap_allocated":10353,"internal_metadata":154523535},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1676,"num_objects_misplaced":-34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1758,"num_bytes_recovered":6806046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.504630"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141364+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:22.141364+0000","last_peered":"2024-06-11T16:03:22.141364+0000","last_clean":"2024-06-11T16:03:22.141364+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:22.141364+0000","last_undegraded":"2024-06-11T16:03:22.141364+0000","last_fullsized":"2024-06-11T16:03:22.141364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141207+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:22.141207+0000","last_peered":"2024-06-11T16:03:22.141207+0000","last_clean":"2024-06-11T16:03:22.141207+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:22.141207+0000","last_undegraded":"2024-06-11T16:03:22.141207+0000","last_fullsized":"2024-06-11T16:03:22.141207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145492+0000","last_change":"2024-06-11T16:03:19.141285+0000","last_active":"2024-06-11T16:03:23.145492+0000","last_peered":"2024-06-11T16:03:23.145492+0000","last_clean":"2024-06-11T16:03:23.145492+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:23.145492+0000","last_undegraded":"2024-06-11T16:03:23.145492+0000","last_fullsized":"2024-06-11T16:03:23.145492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:30:03.704426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145456+0000","last_change":"2024-06-11T16:03:19.140014+0000","last_active":"2024-06-11T16:03:23.145456+0000","last_peered":"2024-06-11T16:03:23.145456+0000","last_clean":"2024-06-11T16:03:23.145456+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:23.145456+0000","last_undegraded":"2024-06-11T16:03:23.145456+0000","last_fullsized":"2024-06-11T16:03:23.145456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:27:46.785658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141659+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:22.141659+0000","last_peered":"2024-06-11T16:03:22.141659+0000","last_clean":"2024-06-11T16:03:22.141659+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:22.141659+0000","last_undegraded":"2024-06-11T16:03:22.141659+0000","last_fullsized":"2024-06-11T16:03:22.141659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145732+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:23.145732+0000","last_peered":"2024-06-11T16:03:23.145732+0000","last_clean":"2024-06-11T16:03:23.145732+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:23.145732+0000","last_undegraded":"2024-06-11T16:03:23.145732+0000","last_fullsized":"2024-06-11T16:03:23.145732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145006+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:23.145006+0000","last_peered":"2024-06-11T16:03:23.145006+0000","last_clean":"2024-06-11T16:03:23.145006+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:23.145006+0000","last_undegraded":"2024-06-11T16:03:23.145006+0000","last_fullsized":"2024-06-11T16:03:23.145006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":246,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144939+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:23.144939+0000","last_peered":"2024-06-11T16:03:23.144939+0000","last_clean":"2024-06-11T16:03:23.144939+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:23.144939+0000","last_undegraded":"2024-06-11T16:03:23.144939+0000","last_fullsized":"2024-06-11T16:03:23.144939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:12:32.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139329+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:22.139329+0000","last_peered":"2024-06-11T16:03:22.139329+0000","last_clean":"2024-06-11T16:03:22.139329+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:22.139329+0000","last_undegraded":"2024-06-11T16:03:22.139329+0000","last_fullsized":"2024-06-11T16:03:22.139329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":236,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141311+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:22.141311+0000","last_peered":"2024-06-11T16:03:22.141311+0000","last_clean":"2024-06-11T16:03:22.141311+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:22.141311+0000","last_undegraded":"2024-06-11T16:03:22.141311+0000","last_fullsized":"2024-06-11T16:03:22.141311+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146420+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146420+0000","last_peered":"2024-06-11T16:03:23.146420+0000","last_clean":"2024-06-11T16:03:23.146420+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146420+0000","last_undegraded":"2024-06-11T16:03:23.146420+0000","last_fullsized":"2024-06-11T16:03:23.146420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":389,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141507+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:22.141507+0000","last_peered":"2024-06-11T16:03:22.141507+0000","last_clean":"2024-06-11T16:03:22.141507+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:22.141507+0000","last_undegraded":"2024-06-11T16:03:22.141507+0000","last_fullsized":"2024-06-11T16:03:22.141507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":234,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141427+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:22.141427+0000","last_peered":"2024-06-11T16:03:22.141427+0000","last_clean":"2024-06-11T16:03:22.141427+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:22.141427+0000","last_undegraded":"2024-06-11T16:03:22.141427+0000","last_fullsized":"2024-06-11T16:03:22.141427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146455+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:23.146455+0000","last_peered":"2024-06-11T16:03:23.146455+0000","last_clean":"2024-06-11T16:03:23.146455+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:23.146455+0000","last_undegraded":"2024-06-11T16:03:23.146455+0000","last_fullsized":"2024-06-11T16:03:23.146455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145265+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:23.145265+0000","last_peered":"2024-06-11T16:03:23.145265+0000","last_clean":"2024-06-11T16:03:23.145265+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:23.145265+0000","last_undegraded":"2024-06-11T16:03:23.145265+0000","last_fullsized":"2024-06-11T16:03:23.145265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":316,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139695+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:22.139695+0000","last_peered":"2024-06-11T16:03:22.139695+0000","last_clean":"2024-06-11T16:03:22.139695+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:22.139695+0000","last_undegraded":"2024-06-11T16:03:22.139695+0000","last_fullsized":"2024-06-11T16:03:22.139695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":230,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141420+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:22.141420+0000","last_peered":"2024-06-11T16:03:22.141420+0000","last_clean":"2024-06-11T16:03:22.141420+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:22.141420+0000","last_undegraded":"2024-06-11T16:03:22.141420+0000","last_fullsized":"2024-06-11T16:03:22.141420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139487+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:22.139487+0000","last_peered":"2024-06-11T16:03:22.139487+0000","last_clean":"2024-06-11T16:03:22.139487+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:22.139487+0000","last_undegraded":"2024-06-11T16:03:22.139487+0000","last_fullsized":"2024-06-11T16:03:22.139487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":282,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145987+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.145987+0000","last_peered":"2024-06-11T16:03:23.145987+0000","last_clean":"2024-06-11T16:03:23.145987+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.145987+0000","last_undegraded":"2024-06-11T16:03:23.145987+0000","last_fullsized":"2024-06-11T16:03:23.145987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":276,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146241+0000","last_change":"2024-06-11T16:03:19.139021+0000","last_active":"2024-06-11T16:03:23.146241+0000","last_peered":"2024-06-11T16:03:23.146241+0000","last_clean":"2024-06-11T16:03:23.146241+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:23.146241+0000","last_undegraded":"2024-06-11T16:03:23.146241+0000","last_fullsized":"2024-06-11T16:03:23.146241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:04.174761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":446,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141756+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:22.141756+0000","last_peered":"2024-06-11T16:03:22.141756+0000","last_clean":"2024-06-11T16:03:22.141756+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:22.141756+0000","last_undegraded":"2024-06-11T16:03:22.141756+0000","last_fullsized":"2024-06-11T16:03:22.141756+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":536,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138607+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:22.138607+0000","last_peered":"2024-06-11T16:03:22.138607+0000","last_clean":"2024-06-11T16:03:22.138607+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:22.138607+0000","last_undegraded":"2024-06-11T16:03:22.138607+0000","last_fullsized":"2024-06-11T16:03:22.138607+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":270,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140733+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:22.140733+0000","last_peered":"2024-06-11T16:03:22.140733+0000","last_clean":"2024-06-11T16:03:22.140733+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:22.140733+0000","last_undegraded":"2024-06-11T16:03:22.140733+0000","last_fullsized":"2024-06-11T16:03:22.140733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":428,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":604,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139239+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:22.139239+0000","last_peered":"2024-06-11T16:03:22.139239+0000","last_clean":"2024-06-11T16:03:22.139239+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:22.139239+0000","last_undegraded":"2024-06-11T16:03:22.139239+0000","last_fullsized":"2024-06-11T16:03:22.139239+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154833+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:23.154833+0000","last_peered":"2024-06-11T16:03:23.154833+0000","last_clean":"2024-06-11T16:03:23.154833+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:23.154833+0000","last_undegraded":"2024-06-11T16:03:23.154833+0000","last_fullsized":"2024-06-11T16:03:23.154833+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:18:18.583852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":491,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141930+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:22.141930+0000","last_peered":"2024-06-11T16:03:22.141930+0000","last_clean":"2024-06-11T16:03:22.141930+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:22.141930+0000","last_undegraded":"2024-06-11T16:03:22.141930+0000","last_fullsized":"2024-06-11T16:03:22.141930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":320,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139254+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:22.139254+0000","last_peered":"2024-06-11T16:03:22.139254+0000","last_clean":"2024-06-11T16:03:22.139254+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:22.139254+0000","last_undegraded":"2024-06-11T16:03:22.139254+0000","last_fullsized":"2024-06-11T16:03:22.139254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.144028+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:22.144028+0000","last_peered":"2024-06-11T16:03:22.144028+0000","last_clean":"2024-06-11T16:03:22.144028+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:22.144028+0000","last_undegraded":"2024-06-11T16:03:22.144028+0000","last_fullsized":"2024-06-11T16:03:22.144028+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138677+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:22.138677+0000","last_peered":"2024-06-11T16:03:22.138677+0000","last_clean":"2024-06-11T16:03:22.138677+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:22.138677+0000","last_undegraded":"2024-06-11T16:03:22.138677+0000","last_fullsized":"2024-06-11T16:03:22.138677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144947+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.144947+0000","last_peered":"2024-06-11T16:03:23.144947+0000","last_clean":"2024-06-11T16:03:23.144947+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.144947+0000","last_undegraded":"2024-06-11T16:03:23.144947+0000","last_fullsized":"2024-06-11T16:03:23.144947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":253,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141711+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:22.141711+0000","last_peered":"2024-06-11T16:03:22.141711+0000","last_clean":"2024-06-11T16:03:22.141711+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:22.141711+0000","last_undegraded":"2024-06-11T16:03:22.141711+0000","last_fullsized":"2024-06-11T16:03:22.141711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146373+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:23.146373+0000","last_peered":"2024-06-11T16:03:23.146373+0000","last_clean":"2024-06-11T16:03:23.146373+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:23.146373+0000","last_undegraded":"2024-06-11T16:03:23.146373+0000","last_fullsized":"2024-06-11T16:03:23.146373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141532+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:22.141532+0000","last_peered":"2024-06-11T16:03:22.141532+0000","last_clean":"2024-06-11T16:03:22.141532+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:22.141532+0000","last_undegraded":"2024-06-11T16:03:22.141532+0000","last_fullsized":"2024-06-11T16:03:22.141532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139067+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:22.139067+0000","last_peered":"2024-06-11T16:03:22.139067+0000","last_clean":"2024-06-11T16:03:22.139067+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:22.139067+0000","last_undegraded":"2024-06-11T16:03:22.139067+0000","last_fullsized":"2024-06-11T16:03:22.139067+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":568,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139481+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:22.139481+0000","last_peered":"2024-06-11T16:03:22.139481+0000","last_clean":"2024-06-11T16:03:22.139481+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:22.139481+0000","last_undegraded":"2024-06-11T16:03:22.139481+0000","last_fullsized":"2024-06-11T16:03:22.139481+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140904+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:22.140904+0000","last_peered":"2024-06-11T16:03:22.140904+0000","last_clean":"2024-06-11T16:03:22.140904+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:22.140904+0000","last_undegraded":"2024-06-11T16:03:22.140904+0000","last_fullsized":"2024-06-11T16:03:22.140904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":577,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139400+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:22.139400+0000","last_peered":"2024-06-11T16:03:22.139400+0000","last_clean":"2024-06-11T16:03:22.139400+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:22.139400+0000","last_undegraded":"2024-06-11T16:03:22.139400+0000","last_fullsized":"2024-06-11T16:03:22.139400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145000+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:23.145000+0000","last_peered":"2024-06-11T16:03:23.145000+0000","last_clean":"2024-06-11T16:03:23.145000+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:23.145000+0000","last_undegraded":"2024-06-11T16:03:23.145000+0000","last_fullsized":"2024-06-11T16:03:23.145000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145743+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145743+0000","last_peered":"2024-06-11T16:03:23.145743+0000","last_clean":"2024-06-11T16:03:23.145743+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145743+0000","last_undegraded":"2024-06-11T16:03:23.145743+0000","last_fullsized":"2024-06-11T16:03:23.145743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":494,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140871+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:22.140871+0000","last_peered":"2024-06-11T16:03:22.140871+0000","last_clean":"2024-06-11T16:03:22.140871+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:22.140871+0000","last_undegraded":"2024-06-11T16:03:22.140871+0000","last_fullsized":"2024-06-11T16:03:22.140871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":82,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141547+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:22.141547+0000","last_peered":"2024-06-11T16:03:22.141547+0000","last_clean":"2024-06-11T16:03:22.141547+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:22.141547+0000","last_undegraded":"2024-06-11T16:03:22.141547+0000","last_fullsized":"2024-06-11T16:03:22.141547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":277,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140791+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:22.140791+0000","last_peered":"2024-06-11T16:03:22.140791+0000","last_clean":"2024-06-11T16:03:22.140791+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:22.140791+0000","last_undegraded":"2024-06-11T16:03:22.140791+0000","last_fullsized":"2024-06-11T16:03:22.140791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146007+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:23.146007+0000","last_peered":"2024-06-11T16:03:23.146007+0000","last_clean":"2024-06-11T16:03:23.146007+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:23.146007+0000","last_undegraded":"2024-06-11T16:03:23.146007+0000","last_fullsized":"2024-06-11T16:03:23.146007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154797+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:23.154797+0000","last_peered":"2024-06-11T16:03:23.154797+0000","last_clean":"2024-06-11T16:03:23.154797+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:23.154797+0000","last_undegraded":"2024-06-11T16:03:23.154797+0000","last_fullsized":"2024-06-11T16:03:23.154797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:47:50.845754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145570+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145570+0000","last_peered":"2024-06-11T16:03:23.145570+0000","last_clean":"2024-06-11T16:03:23.145570+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145570+0000","last_undegraded":"2024-06-11T16:03:23.145570+0000","last_fullsized":"2024-06-11T16:03:23.145570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":540,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143879+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:22.143879+0000","last_peered":"2024-06-11T16:03:22.143879+0000","last_clean":"2024-06-11T16:03:22.143879+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:22.143879+0000","last_undegraded":"2024-06-11T16:03:22.143879+0000","last_fullsized":"2024-06-11T16:03:22.143879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140080+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:22.140080+0000","last_peered":"2024-06-11T16:03:22.140080+0000","last_clean":"2024-06-11T16:03:22.140080+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:22.140080+0000","last_undegraded":"2024-06-11T16:03:22.140080+0000","last_fullsized":"2024-06-11T16:03:22.140080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145391+0000","last_change":"2024-06-11T16:03:20.143760+0000","last_active":"2024-06-11T16:03:23.145391+0000","last_peered":"2024-06-11T16:03:23.145391+0000","last_clean":"2024-06-11T16:03:23.145391+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:23.145391+0000","last_undegraded":"2024-06-11T16:03:23.145391+0000","last_fullsized":"2024-06-11T16:03:23.145391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:28.257417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146275+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146275+0000","last_peered":"2024-06-11T16:03:23.146275+0000","last_clean":"2024-06-11T16:03:23.146275+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146275+0000","last_undegraded":"2024-06-11T16:03:23.146275+0000","last_fullsized":"2024-06-11T16:03:23.146275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146312+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:23.146312+0000","last_peered":"2024-06-11T16:03:23.146312+0000","last_clean":"2024-06-11T16:03:23.146312+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:23.146312+0000","last_undegraded":"2024-06-11T16:03:23.146312+0000","last_fullsized":"2024-06-11T16:03:23.146312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:18.597916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141010+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:22.141010+0000","last_peered":"2024-06-11T16:03:22.141010+0000","last_clean":"2024-06-11T16:03:22.141010+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:22.141010+0000","last_undegraded":"2024-06-11T16:03:22.141010+0000","last_fullsized":"2024-06-11T16:03:22.141010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":240,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145768+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145768+0000","last_peered":"2024-06-11T16:03:23.145768+0000","last_clean":"2024-06-11T16:03:23.145768+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145768+0000","last_undegraded":"2024-06-11T16:03:23.145768+0000","last_fullsized":"2024-06-11T16:03:23.145768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:11.936266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140921+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:22.140921+0000","last_peered":"2024-06-11T16:03:22.140921+0000","last_clean":"2024-06-11T16:03:22.140921+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:22.140921+0000","last_undegraded":"2024-06-11T16:03:22.140921+0000","last_fullsized":"2024-06-11T16:03:22.140921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":295,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139474+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:22.139474+0000","last_peered":"2024-06-11T16:03:22.139474+0000","last_clean":"2024-06-11T16:03:22.139474+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:22.139474+0000","last_undegraded":"2024-06-11T16:03:22.139474+0000","last_fullsized":"2024-06-11T16:03:22.139474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144819+0000","last_change":"2024-06-11T16:03:19.139291+0000","last_active":"2024-06-11T16:03:23.144819+0000","last_peered":"2024-06-11T16:03:23.144819+0000","last_clean":"2024-06-11T16:03:23.144819+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:23.144819+0000","last_undegraded":"2024-06-11T16:03:23.144819+0000","last_fullsized":"2024-06-11T16:03:23.144819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:00.383856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146093+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146093+0000","last_peered":"2024-06-11T16:03:23.146093+0000","last_clean":"2024-06-11T16:03:23.146093+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146093+0000","last_undegraded":"2024-06-11T16:03:23.146093+0000","last_fullsized":"2024-06-11T16:03:23.146093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139907+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:22.139907+0000","last_peered":"2024-06-11T16:03:22.139907+0000","last_clean":"2024-06-11T16:03:22.139907+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:22.139907+0000","last_undegraded":"2024-06-11T16:03:22.139907+0000","last_fullsized":"2024-06-11T16:03:22.139907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145829+0000","last_change":"2024-06-11T16:03:19.141284+0000","last_active":"2024-06-11T16:03:23.145829+0000","last_peered":"2024-06-11T16:03:23.145829+0000","last_clean":"2024-06-11T16:03:23.145829+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:23.145829+0000","last_undegraded":"2024-06-11T16:03:23.145829+0000","last_fullsized":"2024-06-11T16:03:23.145829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:27:19.294972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145144+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:23.145144+0000","last_peered":"2024-06-11T16:03:23.145144+0000","last_clean":"2024-06-11T16:03:23.145144+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:23.145144+0000","last_undegraded":"2024-06-11T16:03:23.145144+0000","last_fullsized":"2024-06-11T16:03:23.145144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":246,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138858+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:22.138858+0000","last_peered":"2024-06-11T16:03:22.138858+0000","last_clean":"2024-06-11T16:03:22.138858+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:22.138858+0000","last_undegraded":"2024-06-11T16:03:22.138858+0000","last_fullsized":"2024-06-11T16:03:22.138858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141383+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:22.141383+0000","last_peered":"2024-06-11T16:03:22.141383+0000","last_clean":"2024-06-11T16:03:22.141383+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:22.141383+0000","last_undegraded":"2024-06-11T16:03:22.141383+0000","last_fullsized":"2024-06-11T16:03:22.141383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139142+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:22.139142+0000","last_peered":"2024-06-11T16:03:22.139142+0000","last_clean":"2024-06-11T16:03:22.139142+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:22.139142+0000","last_undegraded":"2024-06-11T16:03:22.139142+0000","last_fullsized":"2024-06-11T16:03:22.139142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":135,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140945+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:22.140945+0000","last_peered":"2024-06-11T16:03:22.140945+0000","last_clean":"2024-06-11T16:03:22.140945+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:22.140945+0000","last_undegraded":"2024-06-11T16:03:22.140945+0000","last_fullsized":"2024-06-11T16:03:22.140945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":323,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139558+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:22.139558+0000","last_peered":"2024-06-11T16:03:22.139558+0000","last_clean":"2024-06-11T16:03:22.139558+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:22.139558+0000","last_undegraded":"2024-06-11T16:03:22.139558+0000","last_fullsized":"2024-06-11T16:03:22.139558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146173+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146173+0000","last_peered":"2024-06-11T16:03:23.146173+0000","last_clean":"2024-06-11T16:03:23.146173+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146173+0000","last_undegraded":"2024-06-11T16:03:23.146173+0000","last_fullsized":"2024-06-11T16:03:23.146173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145928+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:23.145928+0000","last_peered":"2024-06-11T16:03:23.145928+0000","last_clean":"2024-06-11T16:03:23.145928+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:23.145928+0000","last_undegraded":"2024-06-11T16:03:23.145928+0000","last_fullsized":"2024-06-11T16:03:23.145928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":306,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139087+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:22.139087+0000","last_peered":"2024-06-11T16:03:22.139087+0000","last_clean":"2024-06-11T16:03:22.139087+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:22.139087+0000","last_undegraded":"2024-06-11T16:03:22.139087+0000","last_fullsized":"2024-06-11T16:03:22.139087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146132+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146132+0000","last_peered":"2024-06-11T16:03:23.146132+0000","last_clean":"2024-06-11T16:03:23.146132+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146132+0000","last_undegraded":"2024-06-11T16:03:23.146132+0000","last_fullsized":"2024-06-11T16:03:23.146132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139210+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:22.139210+0000","last_peered":"2024-06-11T16:03:22.139210+0000","last_clean":"2024-06-11T16:03:22.139210+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:22.139210+0000","last_undegraded":"2024-06-11T16:03:22.139210+0000","last_fullsized":"2024-06-11T16:03:22.139210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":416,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141917+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:22.141917+0000","last_peered":"2024-06-11T16:03:22.141917+0000","last_clean":"2024-06-11T16:03:22.141917+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:22.141917+0000","last_undegraded":"2024-06-11T16:03:22.141917+0000","last_fullsized":"2024-06-11T16:03:22.141917+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139207+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:22.139207+0000","last_peered":"2024-06-11T16:03:22.139207+0000","last_clean":"2024-06-11T16:03:22.139207+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:22.139207+0000","last_undegraded":"2024-06-11T16:03:22.139207+0000","last_fullsized":"2024-06-11T16:03:22.139207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141908+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:22.141908+0000","last_peered":"2024-06-11T16:03:22.141908+0000","last_clean":"2024-06-11T16:03:22.141908+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:22.141908+0000","last_undegraded":"2024-06-11T16:03:22.141908+0000","last_fullsized":"2024-06-11T16:03:22.141908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141549+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:22.141549+0000","last_peered":"2024-06-11T16:03:22.141549+0000","last_clean":"2024-06-11T16:03:22.141549+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:22.141549+0000","last_undegraded":"2024-06-11T16:03:22.141549+0000","last_fullsized":"2024-06-11T16:03:22.141549+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139816+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:22.139816+0000","last_peered":"2024-06-11T16:03:22.139816+0000","last_clean":"2024-06-11T16:03:22.139816+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:22.139816+0000","last_undegraded":"2024-06-11T16:03:22.139816+0000","last_fullsized":"2024-06-11T16:03:22.139816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139707+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:22.139707+0000","last_peered":"2024-06-11T16:03:22.139707+0000","last_clean":"2024-06-11T16:03:22.139707+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:22.139707+0000","last_undegraded":"2024-06-11T16:03:22.139707+0000","last_fullsized":"2024-06-11T16:03:22.139707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":511,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.143400+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:22.143400+0000","last_peered":"2024-06-11T16:03:22.143400+0000","last_clean":"2024-06-11T16:03:22.143400+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:22.143400+0000","last_undegraded":"2024-06-11T16:03:22.143400+0000","last_fullsized":"2024-06-11T16:03:22.143400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":212,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139609+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:22.139609+0000","last_peered":"2024-06-11T16:03:22.139609+0000","last_clean":"2024-06-11T16:03:22.139609+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:22.139609+0000","last_undegraded":"2024-06-11T16:03:22.139609+0000","last_fullsized":"2024-06-11T16:03:22.139609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145676+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145676+0000","last_peered":"2024-06-11T16:03:23.145676+0000","last_clean":"2024-06-11T16:03:23.145676+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145676+0000","last_undegraded":"2024-06-11T16:03:23.145676+0000","last_fullsized":"2024-06-11T16:03:23.145676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":396,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.140813+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:22.140813+0000","last_peered":"2024-06-11T16:03:22.140813+0000","last_clean":"2024-06-11T16:03:22.140813+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:22.140813+0000","last_undegraded":"2024-06-11T16:03:22.140813+0000","last_fullsized":"2024-06-11T16:03:22.140813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":211,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145243+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:23.145243+0000","last_peered":"2024-06-11T16:03:23.145243+0000","last_clean":"2024-06-11T16:03:23.145243+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:23.145243+0000","last_undegraded":"2024-06-11T16:03:23.145243+0000","last_fullsized":"2024-06-11T16:03:23.145243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:32:07.842170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145702+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:23.145702+0000","last_peered":"2024-06-11T16:03:23.145702+0000","last_clean":"2024-06-11T16:03:23.145702+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:23.145702+0000","last_undegraded":"2024-06-11T16:03:23.145702+0000","last_fullsized":"2024-06-11T16:03:23.145702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":298,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138832+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:22.138832+0000","last_peered":"2024-06-11T16:03:22.138832+0000","last_clean":"2024-06-11T16:03:22.138832+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:22.138832+0000","last_undegraded":"2024-06-11T16:03:22.138832+0000","last_fullsized":"2024-06-11T16:03:22.138832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141794+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:22.141794+0000","last_peered":"2024-06-11T16:03:22.141794+0000","last_clean":"2024-06-11T16:03:22.141794+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:22.141794+0000","last_undegraded":"2024-06-11T16:03:22.141794+0000","last_fullsized":"2024-06-11T16:03:22.141794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145721+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:23.145721+0000","last_peered":"2024-06-11T16:03:23.145721+0000","last_clean":"2024-06-11T16:03:23.145721+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:23.145721+0000","last_undegraded":"2024-06-11T16:03:23.145721+0000","last_fullsized":"2024-06-11T16:03:23.145721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":575,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138710+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:22.138710+0000","last_peered":"2024-06-11T16:03:22.138710+0000","last_clean":"2024-06-11T16:03:22.138710+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:22.138710+0000","last_undegraded":"2024-06-11T16:03:22.138710+0000","last_fullsized":"2024-06-11T16:03:22.138710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139687+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:22.139687+0000","last_peered":"2024-06-11T16:03:22.139687+0000","last_clean":"2024-06-11T16:03:22.139687+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:22.139687+0000","last_undegraded":"2024-06-11T16:03:22.139687+0000","last_fullsized":"2024-06-11T16:03:22.139687+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":310,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138531+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:22.138531+0000","last_peered":"2024-06-11T16:03:22.138531+0000","last_clean":"2024-06-11T16:03:22.138531+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:22.138531+0000","last_undegraded":"2024-06-11T16:03:22.138531+0000","last_fullsized":"2024-06-11T16:03:22.138531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":509,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141501+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:22.141501+0000","last_peered":"2024-06-11T16:03:22.141501+0000","last_clean":"2024-06-11T16:03:22.141501+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:22.141501+0000","last_undegraded":"2024-06-11T16:03:22.141501+0000","last_fullsized":"2024-06-11T16:03:22.141501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138640+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:22.138640+0000","last_peered":"2024-06-11T16:03:22.138640+0000","last_clean":"2024-06-11T16:03:22.138640+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:22.138640+0000","last_undegraded":"2024-06-11T16:03:22.138640+0000","last_fullsized":"2024-06-11T16:03:22.138640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":521,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139227+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:22.139227+0000","last_peered":"2024-06-11T16:03:22.139227+0000","last_clean":"2024-06-11T16:03:22.139227+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:22.139227+0000","last_undegraded":"2024-06-11T16:03:22.139227+0000","last_fullsized":"2024-06-11T16:03:22.139227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.138815+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:22.138815+0000","last_peered":"2024-06-11T16:03:22.138815+0000","last_clean":"2024-06-11T16:03:22.138815+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:22.138815+0000","last_undegraded":"2024-06-11T16:03:22.138815+0000","last_fullsized":"2024-06-11T16:03:22.138815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":413,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.145204+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:22.145204+0000","last_peered":"2024-06-11T16:03:22.145204+0000","last_clean":"2024-06-11T16:03:22.145204+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:22.145204+0000","last_undegraded":"2024-06-11T16:03:22.145204+0000","last_fullsized":"2024-06-11T16:03:22.145204+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.142278+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:22.142278+0000","last_peered":"2024-06-11T16:03:22.142278+0000","last_clean":"2024-06-11T16:03:22.142278+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:22.142278+0000","last_undegraded":"2024-06-11T16:03:22.142278+0000","last_fullsized":"2024-06-11T16:03:22.142278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":264,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141691+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:22.141691+0000","last_peered":"2024-06-11T16:03:22.141691+0000","last_clean":"2024-06-11T16:03:22.141691+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:22.141691+0000","last_undegraded":"2024-06-11T16:03:22.141691+0000","last_fullsized":"2024-06-11T16:03:22.141691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":66,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141783+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:22.141783+0000","last_peered":"2024-06-11T16:03:22.141783+0000","last_clean":"2024-06-11T16:03:22.141783+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:22.141783+0000","last_undegraded":"2024-06-11T16:03:22.141783+0000","last_fullsized":"2024-06-11T16:03:22.141783+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154860+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:23.154860+0000","last_peered":"2024-06-11T16:03:23.154860+0000","last_clean":"2024-06-11T16:03:23.154860+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:23.154860+0000","last_undegraded":"2024-06-11T16:03:23.154860+0000","last_fullsized":"2024-06-11T16:03:23.154860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:08.358516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145595+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:23.145595+0000","last_peered":"2024-06-11T16:03:23.145595+0000","last_clean":"2024-06-11T16:03:23.145595+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:23.145595+0000","last_undegraded":"2024-06-11T16:03:23.145595+0000","last_fullsized":"2024-06-11T16:03:23.145595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.155216+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:23.155216+0000","last_peered":"2024-06-11T16:03:23.155216+0000","last_clean":"2024-06-11T16:03:23.155216+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:23.155216+0000","last_undegraded":"2024-06-11T16:03:23.155216+0000","last_fullsized":"2024-06-11T16:03:23.155216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:47.274422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141599+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:22.141599+0000","last_peered":"2024-06-11T16:03:22.141599+0000","last_clean":"2024-06-11T16:03:22.141599+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:22.141599+0000","last_undegraded":"2024-06-11T16:03:22.141599+0000","last_fullsized":"2024-06-11T16:03:22.141599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":272,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.141409+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:22.141409+0000","last_peered":"2024-06-11T16:03:22.141409+0000","last_clean":"2024-06-11T16:03:22.141409+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:22.141409+0000","last_undegraded":"2024-06-11T16:03:22.141409+0000","last_fullsized":"2024-06-11T16:03:22.141409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139371+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:22.139371+0000","last_peered":"2024-06-11T16:03:22.139371+0000","last_clean":"2024-06-11T16:03:22.139371+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:22.139371+0000","last_undegraded":"2024-06-11T16:03:22.139371+0000","last_fullsized":"2024-06-11T16:03:22.139371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145150+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145150+0000","last_peered":"2024-06-11T16:03:23.145150+0000","last_clean":"2024-06-11T16:03:23.145150+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145150+0000","last_undegraded":"2024-06-11T16:03:23.145150+0000","last_fullsized":"2024-06-11T16:03:23.145150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-06-11T16:03:22.139592+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:22.139592+0000","last_peered":"2024-06-11T16:03:22.139592+0000","last_clean":"2024-06-11T16:03:22.139592+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:22.139592+0000","last_undegraded":"2024-06-11T16:03:22.139592+0000","last_fullsized":"2024-06-11T16:03:22.139592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69144576,"data_stored":57387655,"data_compressed":4634117,"data_compressed_allocated":5435392,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678023,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65548,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":35833,"kb_avail":94306292,"statfs":{"total":96636764160,"available":96569643008,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":36692996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85820,"kb_used_data":28268,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286020,"statfs":{"total":96636764160,"available":96548884480,"internally_reserved":0,"allocated":28946432,"data_stored":48722254,"data_compressed":6047988,"data_compressed_allocated":7151616,"data_compressed_original":34369536,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85004,"kb_used_data":27456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286836,"statfs":{"total":96636764160,"available":96549720064,"internally_reserved":0,"allocated":28114944,"data_stored":40813216,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23040000,"data_stored":18984594,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22372352,"data_stored":18243981,"data_compressed":1623586,"data_compressed_allocated":1896448,"data_compressed_original":4780032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:29.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T16:03:29.369 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:29.370 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":90,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T16:03:23.136276+0000","last_up_change":"2024-06-11T16:03:00.063621+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":71,"up_thru":89,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6801","nonce":3596598173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6803","nonce":3596598173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6807","nonce":3596598173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6805","nonce":3596598173}]},"public_addr":"172.21.15.171:6801/3596598173","cluster_addr":"172.21.15.171:6803/3596598173","heartbeat_back_addr":"172.21.15.171:6807/3596598173","heartbeat_front_addr":"172.21.15.171:6805/3596598173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":37}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T16:03:30.383 INFO:tasks.ceph:Scrubbing osd.0 2024-06-11T16:03:30.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-11T16:03:30.520 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:03:30.521 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T16:03:30.521 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:03:30.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-11T16:03:30.818 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2024-06-11T16:03:30.831 INFO:tasks.ceph:Scrubbing osd.1 2024-06-11T16:03:30.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-11T16:03:30.954 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:03:30.955 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-11T16:03:30.955 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:03:30.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-11T16:03:31.249 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2024-06-11T16:03:31.262 INFO:tasks.ceph:Scrubbing osd.2 2024-06-11T16:03:31.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-11T16:03:31.388 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-06-11T16:03:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-06-11T16:03:31.388 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-06-11T16:03:31.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-11T16:03:31.684 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2024-06-11T16:03:31.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:31.987 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:31.989 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:31.999 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-06-11T16:03:31.647859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11050,"ondisk_log_size":11050,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":231868,"kb_used_data":80908,"kb_used_omap":10,"kb_used_meta":150901,"kb_avail":282883652,"statfs":{"total":289910292480,"available":289672859648,"internally_reserved":0,"allocated":82849792,"data_stored":140373207,"data_compressed":16997465,"data_compressed_allocated":20094976,"data_compressed_original":98934784,"omap_allocated":10353,"internal_metadata":154523535},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1676,"num_objects_misplaced":-34,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1758,"num_bytes_recovered":6806046,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.508955"},"pg_stats":[{"pgid":"4.3f","version":"64'162","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146611+0000","last_change":"2024-06-11T16:03:14.179636+0000","last_active":"2024-06-11T16:03:23.146611+0000","last_peered":"2024-06-11T16:03:23.146611+0000","last_clean":"2024-06-11T16:03:23.146611+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:23.146611+0000","last_undegraded":"2024-06-11T16:03:23.146611+0000","last_fullsized":"2024-06-11T16:03:23.146611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:30.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":249,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146281+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:23.146281+0000","last_peered":"2024-06-11T16:03:23.146281+0000","last_clean":"2024-06-11T16:03:23.146281+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:23.146281+0000","last_undegraded":"2024-06-11T16:03:23.146281+0000","last_fullsized":"2024-06-11T16:03:23.146281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:35:26.558574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"64'190","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145492+0000","last_change":"2024-06-11T16:03:19.141285+0000","last_active":"2024-06-11T16:03:23.145492+0000","last_peered":"2024-06-11T16:03:23.145492+0000","last_clean":"2024-06-11T16:03:23.145492+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:23.145492+0000","last_undegraded":"2024-06-11T16:03:23.145492+0000","last_fullsized":"2024-06-11T16:03:23.145492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:30:03.704426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"64'129","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145456+0000","last_change":"2024-06-11T16:03:19.140014+0000","last_active":"2024-06-11T16:03:23.145456+0000","last_peered":"2024-06-11T16:03:23.145456+0000","last_clean":"2024-06-11T16:03:23.145456+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:23.145456+0000","last_undegraded":"2024-06-11T16:03:23.145456+0000","last_fullsized":"2024-06-11T16:03:23.145456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:27:46.785658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"64'181","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146082+0000","last_change":"2024-06-11T16:03:14.181248+0000","last_active":"2024-06-11T16:03:23.146082+0000","last_peered":"2024-06-11T16:03:23.146082+0000","last_clean":"2024-06-11T16:03:23.146082+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:23.146082+0000","last_undegraded":"2024-06-11T16:03:23.146082+0000","last_fullsized":"2024-06-11T16:03:23.146082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:31.858627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"64'175","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145732+0000","last_change":"2024-06-11T16:03:18.182949+0000","last_active":"2024-06-11T16:03:23.145732+0000","last_peered":"2024-06-11T16:03:23.145732+0000","last_clean":"2024-06-11T16:03:23.145732+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:23.145732+0000","last_undegraded":"2024-06-11T16:03:23.145732+0000","last_fullsized":"2024-06-11T16:03:23.145732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:34.957990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"64'168","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145006+0000","last_change":"2024-06-11T16:03:18.183086+0000","last_active":"2024-06-11T16:03:23.145006+0000","last_peered":"2024-06-11T16:03:23.145006+0000","last_clean":"2024-06-11T16:03:23.145006+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:23.145006+0000","last_undegraded":"2024-06-11T16:03:23.145006+0000","last_fullsized":"2024-06-11T16:03:23.145006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:34:24.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":246,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144939+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:23.144939+0000","last_peered":"2024-06-11T16:03:23.144939+0000","last_clean":"2024-06-11T16:03:23.144939+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:23.144939+0000","last_undegraded":"2024-06-11T16:03:23.144939+0000","last_fullsized":"2024-06-11T16:03:23.144939+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:12:32.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"64'170","reported_seq":325,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149295+0000","last_change":"2024-06-11T15:58:59.197536+0000","last_active":"2024-06-11T16:03:23.149295+0000","last_peered":"2024-06-11T16:03:23.149295+0000","last_clean":"2024-06-11T16:03:23.149295+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:23.149295+0000","last_undegraded":"2024-06-11T16:03:23.149295+0000","last_fullsized":"2024-06-11T16:03:23.149295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:54:41.115284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"64'160","reported_seq":238,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146361+0000","last_change":"2024-06-11T16:03:14.179381+0000","last_active":"2024-06-11T16:03:23.146361+0000","last_peered":"2024-06-11T16:03:23.146361+0000","last_clean":"2024-06-11T16:03:23.146361+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:23.146361+0000","last_undegraded":"2024-06-11T16:03:23.146361+0000","last_fullsized":"2024-06-11T16:03:23.146361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:31.190451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":252,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146420+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146420+0000","last_peered":"2024-06-11T16:03:23.146420+0000","last_clean":"2024-06-11T16:03:23.146420+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146420+0000","last_undegraded":"2024-06-11T16:03:23.146420+0000","last_fullsized":"2024-06-11T16:03:23.146420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:34:16.278414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":391,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146071+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:23.146071+0000","last_peered":"2024-06-11T16:03:23.146071+0000","last_clean":"2024-06-11T16:03:23.146071+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:23.146071+0000","last_undegraded":"2024-06-11T16:03:23.146071+0000","last_fullsized":"2024-06-11T16:03:23.146071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:30:52.641544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"64'134","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145954+0000","last_change":"2024-06-11T16:03:14.181275+0000","last_active":"2024-06-11T16:03:23.145954+0000","last_peered":"2024-06-11T16:03:23.145954+0000","last_clean":"2024-06-11T16:03:23.145954+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:23.145954+0000","last_undegraded":"2024-06-11T16:03:23.145954+0000","last_fullsized":"2024-06-11T16:03:23.145954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:46:59.253834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"64'170","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146455+0000","last_change":"2024-06-11T16:03:16.189977+0000","last_active":"2024-06-11T16:03:23.146455+0000","last_peered":"2024-06-11T16:03:23.146455+0000","last_clean":"2024-06-11T16:03:23.146455+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:23.146455+0000","last_undegraded":"2024-06-11T16:03:23.146455+0000","last_fullsized":"2024-06-11T16:03:23.146455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:10:40.788055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":236,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:48:57.211473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"64'178","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145265+0000","last_change":"2024-06-11T16:03:16.184775+0000","last_active":"2024-06-11T16:03:23.145265+0000","last_peered":"2024-06-11T16:03:23.145265+0000","last_clean":"2024-06-11T16:03:23.145265+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:23.145265+0000","last_undegraded":"2024-06-11T16:03:23.145265+0000","last_fullsized":"2024-06-11T16:03:23.145265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:34:54.277816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"64'163","reported_seq":318,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149686+0000","last_change":"2024-06-11T15:58:59.199595+0000","last_active":"2024-06-11T16:03:23.149686+0000","last_peered":"2024-06-11T16:03:23.149686+0000","last_clean":"2024-06-11T16:03:23.149686+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:23.149686+0000","last_undegraded":"2024-06-11T16:03:23.149686+0000","last_fullsized":"2024-06-11T16:03:23.149686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:46:49.028506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"64'149","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146484+0000","last_change":"2024-06-11T16:03:14.179807+0000","last_active":"2024-06-11T16:03:23.146484+0000","last_peered":"2024-06-11T16:03:23.146484+0000","last_clean":"2024-06-11T16:03:23.146484+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:23.146484+0000","last_undegraded":"2024-06-11T16:03:23.146484+0000","last_fullsized":"2024-06-11T16:03:23.146484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:25:39.097593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"64'146","reported_seq":301,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149064+0000","last_change":"2024-06-11T15:58:59.197181+0000","last_active":"2024-06-11T16:03:23.149064+0000","last_peered":"2024-06-11T16:03:23.149064+0000","last_clean":"2024-06-11T16:03:23.149064+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:23.149064+0000","last_undegraded":"2024-06-11T16:03:23.149064+0000","last_fullsized":"2024-06-11T16:03:23.149064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:47:43.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":282,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145987+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.145987+0000","last_peered":"2024-06-11T16:03:23.145987+0000","last_clean":"2024-06-11T16:03:23.145987+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.145987+0000","last_undegraded":"2024-06-11T16:03:23.145987+0000","last_fullsized":"2024-06-11T16:03:23.145987+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:02:07.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"64'159","reported_seq":276,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146241+0000","last_change":"2024-06-11T16:03:19.139021+0000","last_active":"2024-06-11T16:03:23.146241+0000","last_peered":"2024-06-11T16:03:23.146241+0000","last_clean":"2024-06-11T16:03:23.146241+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:23.146241+0000","last_undegraded":"2024-06-11T16:03:23.146241+0000","last_fullsized":"2024-06-11T16:03:23.146241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:49:04.174761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":448,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145794+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:23.145794+0000","last_peered":"2024-06-11T16:03:23.145794+0000","last_clean":"2024-06-11T16:03:23.145794+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:23.145794+0000","last_undegraded":"2024-06-11T16:03:23.145794+0000","last_fullsized":"2024-06-11T16:03:23.145794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:40:53.557498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":538,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148141+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:23.148141+0000","last_peered":"2024-06-11T16:03:23.148141+0000","last_clean":"2024-06-11T16:03:23.148141+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:23.148141+0000","last_undegraded":"2024-06-11T16:03:23.148141+0000","last_fullsized":"2024-06-11T16:03:23.148141+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:21:48.033512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"64'167","reported_seq":272,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145498+0000","last_change":"2024-06-11T16:03:14.178846+0000","last_active":"2024-06-11T16:03:23.145498+0000","last_peered":"2024-06-11T16:03:23.145498+0000","last_clean":"2024-06-11T16:03:23.145498+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:23.145498+0000","last_undegraded":"2024-06-11T16:03:23.145498+0000","last_fullsized":"2024-06-11T16:03:23.145498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:12:56.032654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":430,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146683+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:23.146683+0000","last_peered":"2024-06-11T16:03:23.146683+0000","last_clean":"2024-06-11T16:03:23.146683+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:23.146683+0000","last_undegraded":"2024-06-11T16:03:23.146683+0000","last_fullsized":"2024-06-11T16:03:23.146683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:30.505456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":606,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149283+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:23.149283+0000","last_peered":"2024-06-11T16:03:23.149283+0000","last_clean":"2024-06-11T16:03:23.149283+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:23.149283+0000","last_undegraded":"2024-06-11T16:03:23.149283+0000","last_fullsized":"2024-06-11T16:03:23.149283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:45:27.055971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154833+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:23.154833+0000","last_peered":"2024-06-11T16:03:23.154833+0000","last_clean":"2024-06-11T16:03:23.154833+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:23.154833+0000","last_undegraded":"2024-06-11T16:03:23.154833+0000","last_fullsized":"2024-06-11T16:03:23.154833+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:18:18.583852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146517+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:23.146517+0000","last_peered":"2024-06-11T16:03:23.146517+0000","last_clean":"2024-06-11T16:03:23.146517+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:23.146517+0000","last_undegraded":"2024-06-11T16:03:23.146517+0000","last_fullsized":"2024-06-11T16:03:23.146517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:58.762743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"64'166","reported_seq":322,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148930+0000","last_change":"2024-06-11T15:58:59.196154+0000","last_active":"2024-06-11T16:03:23.148930+0000","last_peered":"2024-06-11T16:03:23.148930+0000","last_clean":"2024-06-11T16:03:23.148930+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:23.148930+0000","last_undegraded":"2024-06-11T16:03:23.148930+0000","last_fullsized":"2024-06-11T16:03:23.148930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:46:28.681909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":496,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146483+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:23.146483+0000","last_peered":"2024-06-11T16:03:23.146483+0000","last_clean":"2024-06-11T16:03:23.146483+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:23.146483+0000","last_undegraded":"2024-06-11T16:03:23.146483+0000","last_fullsized":"2024-06-11T16:03:23.146483+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:06.946213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"64'193","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148171+0000","last_change":"2024-06-11T15:58:59.197230+0000","last_active":"2024-06-11T16:03:23.148171+0000","last_peered":"2024-06-11T16:03:23.148171+0000","last_clean":"2024-06-11T16:03:23.148171+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:23.148171+0000","last_undegraded":"2024-06-11T16:03:23.148171+0000","last_fullsized":"2024-06-11T16:03:23.148171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:13:35.393937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144947+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.144947+0000","last_peered":"2024-06-11T16:03:23.144947+0000","last_clean":"2024-06-11T16:03:23.144947+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.144947+0000","last_undegraded":"2024-06-11T16:03:23.144947+0000","last_fullsized":"2024-06-11T16:03:23.144947+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:59:12.565384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"64'155","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146258+0000","last_change":"2024-06-11T16:03:14.179872+0000","last_active":"2024-06-11T16:03:23.146258+0000","last_peered":"2024-06-11T16:03:23.146258+0000","last_clean":"2024-06-11T16:03:23.146258+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:23.146258+0000","last_undegraded":"2024-06-11T16:03:23.146258+0000","last_fullsized":"2024-06-11T16:03:23.146258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:43:37.281816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"64'122","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146373+0000","last_change":"2024-06-11T16:03:16.181907+0000","last_active":"2024-06-11T16:03:23.146373+0000","last_peered":"2024-06-11T16:03:23.146373+0000","last_clean":"2024-06-11T16:03:23.146373+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:23.146373+0000","last_undegraded":"2024-06-11T16:03:23.146373+0000","last_fullsized":"2024-06-11T16:03:23.146373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:56:44.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"64'143","reported_seq":249,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146810+0000","last_change":"2024-06-11T16:03:14.178809+0000","last_active":"2024-06-11T16:03:23.146810+0000","last_peered":"2024-06-11T16:03:23.146810+0000","last_clean":"2024-06-11T16:03:23.146810+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:23.146810+0000","last_undegraded":"2024-06-11T16:03:23.146810+0000","last_fullsized":"2024-06-11T16:03:23.146810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:29:00.543307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":164,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148741+0000","last_change":"2024-06-11T16:03:01.082601+0000","last_active":"2024-06-11T16:03:23.148741+0000","last_peered":"2024-06-11T16:03:23.148741+0000","last_clean":"2024-06-11T16:03:23.148741+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:23.148741+0000","last_undegraded":"2024-06-11T16:03:23.148741+0000","last_fullsized":"2024-06-11T16:03:23.148741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:09:52.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"64'180","reported_seq":570,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149559+0000","last_change":"2024-06-11T16:03:04.098021+0000","last_active":"2024-06-11T16:03:23.149559+0000","last_peered":"2024-06-11T16:03:23.149559+0000","last_clean":"2024-06-11T16:03:23.149559+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:23.149559+0000","last_undegraded":"2024-06-11T16:03:23.149559+0000","last_fullsized":"2024-06-11T16:03:23.149559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:34.874353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145854+0000","last_change":"2024-06-11T16:03:15.172261+0000","last_active":"2024-06-11T16:03:23.145854+0000","last_peered":"2024-06-11T16:03:23.145854+0000","last_clean":"2024-06-11T16:03:23.145854+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:23.145854+0000","last_undegraded":"2024-06-11T16:03:23.145854+0000","last_fullsized":"2024-06-11T16:03:23.145854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:23:12.929426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"64'213","reported_seq":579,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149295+0000","last_change":"2024-06-11T16:03:05.094681+0000","last_active":"2024-06-11T16:03:23.149295+0000","last_peered":"2024-06-11T16:03:23.149295+0000","last_clean":"2024-06-11T16:03:23.149295+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:23.149295+0000","last_undegraded":"2024-06-11T16:03:23.149295+0000","last_fullsized":"2024-06-11T16:03:23.149295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:15:12.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"62'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145000+0000","last_change":"2024-06-11T16:03:16.199892+0000","last_active":"2024-06-11T16:03:23.145000+0000","last_peered":"2024-06-11T16:03:23.145000+0000","last_clean":"2024-06-11T16:03:23.145000+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:23.145000+0000","last_undegraded":"2024-06-11T16:03:23.145000+0000","last_fullsized":"2024-06-11T16:03:23.145000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:05:39.560732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145743+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145743+0000","last_peered":"2024-06-11T16:03:23.145743+0000","last_clean":"2024-06-11T16:03:23.145743+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145743+0000","last_undegraded":"2024-06-11T16:03:23.145743+0000","last_fullsized":"2024-06-11T16:03:23.145743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:30:19.408855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":496,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145549+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:23.145549+0000","last_peered":"2024-06-11T16:03:23.145549+0000","last_clean":"2024-06-11T16:03:23.145549+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:23.145549+0000","last_undegraded":"2024-06-11T16:03:23.145549+0000","last_fullsized":"2024-06-11T16:03:23.145549+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:45.916037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146671+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:23.146671+0000","last_peered":"2024-06-11T16:03:23.146671+0000","last_clean":"2024-06-11T16:03:23.146671+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:23.146671+0000","last_undegraded":"2024-06-11T16:03:23.146671+0000","last_fullsized":"2024-06-11T16:03:23.146671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:22.906654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"64'167","reported_seq":279,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145681+0000","last_change":"2024-06-11T16:03:14.179658+0000","last_active":"2024-06-11T16:03:23.145681+0000","last_peered":"2024-06-11T16:03:23.145681+0000","last_clean":"2024-06-11T16:03:23.145681+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:23.145681+0000","last_undegraded":"2024-06-11T16:03:23.145681+0000","last_fullsized":"2024-06-11T16:03:23.145681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:40:00.902833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"64'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146007+0000","last_change":"2024-06-11T16:03:16.201905+0000","last_active":"2024-06-11T16:03:23.146007+0000","last_peered":"2024-06-11T16:03:23.146007+0000","last_clean":"2024-06-11T16:03:23.146007+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:23.146007+0000","last_undegraded":"2024-06-11T16:03:23.146007+0000","last_fullsized":"2024-06-11T16:03:23.146007+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:31.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154797+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:23.154797+0000","last_peered":"2024-06-11T16:03:23.154797+0000","last_clean":"2024-06-11T16:03:23.154797+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:23.154797+0000","last_undegraded":"2024-06-11T16:03:23.154797+0000","last_fullsized":"2024-06-11T16:03:23.154797+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:47:50.845754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145570+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145570+0000","last_peered":"2024-06-11T16:03:23.145570+0000","last_clean":"2024-06-11T16:03:23.145570+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145570+0000","last_undegraded":"2024-06-11T16:03:23.145570+0000","last_fullsized":"2024-06-11T16:03:23.145570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:31:36.740106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":542,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149001+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:23.149001+0000","last_peered":"2024-06-11T16:03:23.149001+0000","last_clean":"2024-06-11T16:03:23.149001+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:23.149001+0000","last_undegraded":"2024-06-11T16:03:23.149001+0000","last_fullsized":"2024-06-11T16:03:23.149001+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:54.305514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":192,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149348+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:23.149348+0000","last_peered":"2024-06-11T16:03:23.149348+0000","last_clean":"2024-06-11T16:03:23.149348+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:23.149348+0000","last_undegraded":"2024-06-11T16:03:23.149348+0000","last_fullsized":"2024-06-11T16:03:23.149348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:32:09.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"64'175","reported_seq":291,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145391+0000","last_change":"2024-06-11T16:03:20.143760+0000","last_active":"2024-06-11T16:03:23.145391+0000","last_peered":"2024-06-11T16:03:23.145391+0000","last_clean":"2024-06-11T16:03:23.145391+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:23.145391+0000","last_undegraded":"2024-06-11T16:03:23.145391+0000","last_fullsized":"2024-06-11T16:03:23.145391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:59:28.257417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146275+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146275+0000","last_peered":"2024-06-11T16:03:23.146275+0000","last_clean":"2024-06-11T16:03:23.146275+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146275+0000","last_undegraded":"2024-06-11T16:03:23.146275+0000","last_fullsized":"2024-06-11T16:03:23.146275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:08:37.516464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":228,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146312+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:23.146312+0000","last_peered":"2024-06-11T16:03:23.146312+0000","last_clean":"2024-06-11T16:03:23.146312+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:23.146312+0000","last_undegraded":"2024-06-11T16:03:23.146312+0000","last_fullsized":"2024-06-11T16:03:23.146312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:57:18.597916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146108+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:23.146108+0000","last_peered":"2024-06-11T16:03:23.146108+0000","last_clean":"2024-06-11T16:03:23.146108+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:23.146108+0000","last_undegraded":"2024-06-11T16:03:23.146108+0000","last_fullsized":"2024-06-11T16:03:23.146108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:45:31.367754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":240,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145768+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145768+0000","last_peered":"2024-06-11T16:03:23.145768+0000","last_clean":"2024-06-11T16:03:23.145768+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145768+0000","last_undegraded":"2024-06-11T16:03:23.145768+0000","last_fullsized":"2024-06-11T16:03:23.145768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:11.936266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145648+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:23.145648+0000","last_peered":"2024-06-11T16:03:23.145648+0000","last_clean":"2024-06-11T16:03:23.145648+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:23.145648+0000","last_undegraded":"2024-06-11T16:03:23.145648+0000","last_fullsized":"2024-06-11T16:03:23.145648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:40:22.669512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"64'142","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149429+0000","last_change":"2024-06-11T15:58:59.199189+0000","last_active":"2024-06-11T16:03:23.149429+0000","last_peered":"2024-06-11T16:03:23.149429+0000","last_clean":"2024-06-11T16:03:23.149429+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:23.149429+0000","last_undegraded":"2024-06-11T16:03:23.149429+0000","last_fullsized":"2024-06-11T16:03:23.149429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:48:50.775316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":255,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.144819+0000","last_change":"2024-06-11T16:03:19.139291+0000","last_active":"2024-06-11T16:03:23.144819+0000","last_peered":"2024-06-11T16:03:23.144819+0000","last_clean":"2024-06-11T16:03:23.144819+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:23.144819+0000","last_undegraded":"2024-06-11T16:03:23.144819+0000","last_fullsized":"2024-06-11T16:03:23.144819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:50.119808+0000","last_clean_scrub_stamp":"2024-06-11T15:58:50.119808+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:54:00.383856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146093+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146093+0000","last_peered":"2024-06-11T16:03:23.146093+0000","last_clean":"2024-06-11T16:03:23.146093+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146093+0000","last_undegraded":"2024-06-11T16:03:23.146093+0000","last_fullsized":"2024-06-11T16:03:23.146093+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:51.576637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":182,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148838+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:23.148838+0000","last_peered":"2024-06-11T16:03:23.148838+0000","last_clean":"2024-06-11T16:03:23.148838+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:23.148838+0000","last_undegraded":"2024-06-11T16:03:23.148838+0000","last_fullsized":"2024-06-11T16:03:23.148838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:57:22.709615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"64'149","reported_seq":218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145829+0000","last_change":"2024-06-11T16:03:19.141284+0000","last_active":"2024-06-11T16:03:23.145829+0000","last_peered":"2024-06-11T16:03:23.145829+0000","last_clean":"2024-06-11T16:03:23.145829+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:23.145829+0000","last_undegraded":"2024-06-11T16:03:23.145829+0000","last_fullsized":"2024-06-11T16:03:23.145829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:27:19.294972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145144+0000","last_change":"2024-06-11T16:03:16.188308+0000","last_active":"2024-06-11T16:03:23.145144+0000","last_peered":"2024-06-11T16:03:23.145144+0000","last_clean":"2024-06-11T16:03:23.145144+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:23.145144+0000","last_undegraded":"2024-06-11T16:03:23.145144+0000","last_fullsized":"2024-06-11T16:03:23.145144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:29:00.475948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"63'38","reported_seq":248,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148470+0000","last_change":"2024-06-11T16:03:15.263809+0000","last_active":"2024-06-11T16:03:23.148470+0000","last_peered":"2024-06-11T16:03:23.148470+0000","last_clean":"2024-06-11T16:03:23.148470+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:23.148470+0000","last_undegraded":"2024-06-11T16:03:23.148470+0000","last_fullsized":"2024-06-11T16:03:23.148470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:33:37.243685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"64'162","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146459+0000","last_change":"2024-06-11T16:03:14.179797+0000","last_active":"2024-06-11T16:03:23.146459+0000","last_peered":"2024-06-11T16:03:23.146459+0000","last_clean":"2024-06-11T16:03:23.146459+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:23.146459+0000","last_undegraded":"2024-06-11T16:03:23.146459+0000","last_fullsized":"2024-06-11T16:03:23.146459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:49:30.784324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148650+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:23.148650+0000","last_peered":"2024-06-11T16:03:23.148650+0000","last_clean":"2024-06-11T16:03:23.148650+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:23.148650+0000","last_undegraded":"2024-06-11T16:03:23.148650+0000","last_fullsized":"2024-06-11T16:03:23.148650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:14:52.960467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"60'65","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145717+0000","last_change":"2024-06-11T16:03:15.204617+0000","last_active":"2024-06-11T16:03:23.145717+0000","last_peered":"2024-06-11T16:03:23.145717+0000","last_clean":"2024-06-11T16:03:23.145717+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:23.145717+0000","last_undegraded":"2024-06-11T16:03:23.145717+0000","last_fullsized":"2024-06-11T16:03:23.145717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:59:54.685643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"64'169","reported_seq":325,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149492+0000","last_change":"2024-06-11T15:58:59.197081+0000","last_active":"2024-06-11T16:03:23.149492+0000","last_peered":"2024-06-11T16:03:23.149492+0000","last_clean":"2024-06-11T16:03:23.149492+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:23.149492+0000","last_undegraded":"2024-06-11T16:03:23.149492+0000","last_fullsized":"2024-06-11T16:03:23.149492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:25:17.379086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146173+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146173+0000","last_peered":"2024-06-11T16:03:23.146173+0000","last_clean":"2024-06-11T16:03:23.146173+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146173+0000","last_undegraded":"2024-06-11T16:03:23.146173+0000","last_fullsized":"2024-06-11T16:03:23.146173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:45:05.889652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145928+0000","last_change":"2024-06-11T16:03:16.181009+0000","last_active":"2024-06-11T16:03:23.145928+0000","last_peered":"2024-06-11T16:03:23.145928+0000","last_clean":"2024-06-11T16:03:23.145928+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:23.145928+0000","last_undegraded":"2024-06-11T16:03:23.145928+0000","last_fullsized":"2024-06-11T16:03:23.145928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:44:59.334531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"64'152","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149147+0000","last_change":"2024-06-11T15:58:59.192353+0000","last_active":"2024-06-11T16:03:23.149147+0000","last_peered":"2024-06-11T16:03:23.149147+0000","last_clean":"2024-06-11T16:03:23.149147+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:23.149147+0000","last_undegraded":"2024-06-11T16:03:23.149147+0000","last_fullsized":"2024-06-11T16:03:23.149147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:48:12.033447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146132+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146132+0000","last_peered":"2024-06-11T16:03:23.146132+0000","last_clean":"2024-06-11T16:03:23.146132+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146132+0000","last_undegraded":"2024-06-11T16:03:23.146132+0000","last_fullsized":"2024-06-11T16:03:23.146132+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:35:59.198050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149370+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:23.149370+0000","last_peered":"2024-06-11T16:03:23.149370+0000","last_clean":"2024-06-11T16:03:23.149370+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:23.149370+0000","last_undegraded":"2024-06-11T16:03:23.149370+0000","last_fullsized":"2024-06-11T16:03:23.149370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:28:43.210810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":418,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145977+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:23.145977+0000","last_peered":"2024-06-11T16:03:23.145977+0000","last_clean":"2024-06-11T16:03:23.145977+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:23.145977+0000","last_undegraded":"2024-06-11T16:03:23.145977+0000","last_fullsized":"2024-06-11T16:03:23.145977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:18:15.457298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149270+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:23.149270+0000","last_peered":"2024-06-11T16:03:23.149270+0000","last_clean":"2024-06-11T16:03:23.149270+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:23.149270+0000","last_undegraded":"2024-06-11T16:03:23.149270+0000","last_fullsized":"2024-06-11T16:03:23.149270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:17:54.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.147055+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:23.147055+0000","last_peered":"2024-06-11T16:03:23.147055+0000","last_clean":"2024-06-11T16:03:23.147055+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:23.147055+0000","last_undegraded":"2024-06-11T16:03:23.147055+0000","last_fullsized":"2024-06-11T16:03:23.147055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:31:36.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":477,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146053+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:23.146053+0000","last_peered":"2024-06-11T16:03:23.146053+0000","last_clean":"2024-06-11T16:03:23.146053+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:23.146053+0000","last_undegraded":"2024-06-11T16:03:23.146053+0000","last_fullsized":"2024-06-11T16:03:23.146053+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:05:23.161138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149796+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:23.149796+0000","last_peered":"2024-06-11T16:03:23.149796+0000","last_clean":"2024-06-11T16:03:23.149796+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:23.149796+0000","last_undegraded":"2024-06-11T16:03:23.149796+0000","last_fullsized":"2024-06-11T16:03:23.149796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:25.706891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149679+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:23.149679+0000","last_peered":"2024-06-11T16:03:23.149679+0000","last_clean":"2024-06-11T16:03:23.149679+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:23.149679+0000","last_undegraded":"2024-06-11T16:03:23.149679+0000","last_fullsized":"2024-06-11T16:03:23.149679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:44:53.100133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":513,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148334+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:23.148334+0000","last_peered":"2024-06-11T16:03:23.148334+0000","last_clean":"2024-06-11T16:03:23.148334+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:23.148334+0000","last_undegraded":"2024-06-11T16:03:23.148334+0000","last_fullsized":"2024-06-11T16:03:23.148334+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:29:34.279191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":214,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149593+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:23.149593+0000","last_peered":"2024-06-11T16:03:23.149593+0000","last_clean":"2024-06-11T16:03:23.149593+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:23.149593+0000","last_undegraded":"2024-06-11T16:03:23.149593+0000","last_fullsized":"2024-06-11T16:03:23.149593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:44:04.756157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145676+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145676+0000","last_peered":"2024-06-11T16:03:23.145676+0000","last_clean":"2024-06-11T16:03:23.145676+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145676+0000","last_undegraded":"2024-06-11T16:03:23.145676+0000","last_fullsized":"2024-06-11T16:03:23.145676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:41:24.167522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"64'137","reported_seq":398,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145672+0000","last_change":"2024-06-11T16:03:18.181523+0000","last_active":"2024-06-11T16:03:23.145672+0000","last_peered":"2024-06-11T16:03:23.145672+0000","last_clean":"2024-06-11T16:03:23.145672+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:23.145672+0000","last_undegraded":"2024-06-11T16:03:23.145672+0000","last_fullsized":"2024-06-11T16:03:23.145672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:36:23.533045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":211,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145243+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:23.145243+0000","last_peered":"2024-06-11T16:03:23.145243+0000","last_clean":"2024-06-11T16:03:23.145243+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:23.145243+0000","last_undegraded":"2024-06-11T16:03:23.145243+0000","last_fullsized":"2024-06-11T16:03:23.145243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:32:07.842170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"69'51","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145702+0000","last_change":"2024-06-11T16:03:16.183604+0000","last_active":"2024-06-11T16:03:23.145702+0000","last_peered":"2024-06-11T16:03:23.145702+0000","last_clean":"2024-06-11T16:03:23.145702+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:23.145702+0000","last_undegraded":"2024-06-11T16:03:23.145702+0000","last_fullsized":"2024-06-11T16:03:23.145702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:09.869079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"64'145","reported_seq":300,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148688+0000","last_change":"2024-06-11T15:58:59.194982+0000","last_active":"2024-06-11T16:03:23.148688+0000","last_peered":"2024-06-11T16:03:23.148688+0000","last_clean":"2024-06-11T16:03:23.148688+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:23.148688+0000","last_undegraded":"2024-06-11T16:03:23.148688+0000","last_fullsized":"2024-06-11T16:03:23.148688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:34:57.048035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":181,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146983+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:23.146983+0000","last_peered":"2024-06-11T16:03:23.146983+0000","last_clean":"2024-06-11T16:03:23.146983+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:23.146983+0000","last_undegraded":"2024-06-11T16:03:23.146983+0000","last_fullsized":"2024-06-11T16:03:23.146983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:18:13.977589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145721+0000","last_change":"2024-06-11T16:03:16.183868+0000","last_active":"2024-06-11T16:03:23.145721+0000","last_peered":"2024-06-11T16:03:23.145721+0000","last_clean":"2024-06-11T16:03:23.145721+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:23.145721+0000","last_undegraded":"2024-06-11T16:03:23.145721+0000","last_fullsized":"2024-06-11T16:03:23.145721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:51:12.774995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":577,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148284+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:23.148284+0000","last_peered":"2024-06-11T16:03:23.148284+0000","last_clean":"2024-06-11T16:03:23.148284+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:23.148284+0000","last_undegraded":"2024-06-11T16:03:23.148284+0000","last_fullsized":"2024-06-11T16:03:23.148284+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:45.017476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149682+0000","last_change":"2024-06-11T16:03:15.194598+0000","last_active":"2024-06-11T16:03:23.149682+0000","last_peered":"2024-06-11T16:03:23.149682+0000","last_clean":"2024-06-11T16:03:23.149682+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:23.149682+0000","last_undegraded":"2024-06-11T16:03:23.149682+0000","last_fullsized":"2024-06-11T16:03:23.149682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:35:18.261437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"64'157","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148322+0000","last_change":"2024-06-11T15:58:59.196071+0000","last_active":"2024-06-11T16:03:23.148322+0000","last_peered":"2024-06-11T16:03:23.148322+0000","last_clean":"2024-06-11T16:03:23.148322+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:23.148322+0000","last_undegraded":"2024-06-11T16:03:23.148322+0000","last_fullsized":"2024-06-11T16:03:23.148322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:00:36.757494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":511,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146716+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:23.146716+0000","last_peered":"2024-06-11T16:03:23.146716+0000","last_clean":"2024-06-11T16:03:23.146716+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:23.146716+0000","last_undegraded":"2024-06-11T16:03:23.146716+0000","last_fullsized":"2024-06-11T16:03:23.146716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:42:48.681850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148580+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:23.148580+0000","last_peered":"2024-06-11T16:03:23.148580+0000","last_clean":"2024-06-11T16:03:23.148580+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:23.148580+0000","last_undegraded":"2024-06-11T16:03:23.148580+0000","last_fullsized":"2024-06-11T16:03:23.148580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:27:47.193408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":523,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149307+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:23.149307+0000","last_peered":"2024-06-11T16:03:23.149307+0000","last_clean":"2024-06-11T16:03:23.149307+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:23.149307+0000","last_undegraded":"2024-06-11T16:03:23.149307+0000","last_fullsized":"2024-06-11T16:03:23.149307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:06:20.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":169,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148472+0000","last_change":"2024-06-11T16:03:15.195833+0000","last_active":"2024-06-11T16:03:23.148472+0000","last_peered":"2024-06-11T16:03:23.148472+0000","last_clean":"2024-06-11T16:03:23.148472+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:23.148472+0000","last_undegraded":"2024-06-11T16:03:23.148472+0000","last_fullsized":"2024-06-11T16:03:23.148472+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:23:29.819763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":415,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146750+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:23.146750+0000","last_peered":"2024-06-11T16:03:23.146750+0000","last_clean":"2024-06-11T16:03:23.146750+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:23.146750+0000","last_undegraded":"2024-06-11T16:03:23.146750+0000","last_fullsized":"2024-06-11T16:03:23.146750+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:21:09.164329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146650+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:23.146650+0000","last_peered":"2024-06-11T16:03:23.146650+0000","last_clean":"2024-06-11T16:03:23.146650+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:23.146650+0000","last_undegraded":"2024-06-11T16:03:23.146650+0000","last_fullsized":"2024-06-11T16:03:23.146650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:01:50.862363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"64'159","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146147+0000","last_change":"2024-06-11T16:03:14.179674+0000","last_active":"2024-06-11T16:03:23.146147+0000","last_peered":"2024-06-11T16:03:23.146147+0000","last_clean":"2024-06-11T16:03:23.146147+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:23.146147+0000","last_undegraded":"2024-06-11T16:03:23.146147+0000","last_fullsized":"2024-06-11T16:03:23.146147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:45:52.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'6","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146205+0000","last_change":"2024-06-11T16:03:15.243817+0000","last_active":"2024-06-11T16:03:23.146205+0000","last_peered":"2024-06-11T16:03:23.146205+0000","last_clean":"2024-06-11T16:03:23.146205+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:23.146205+0000","last_undegraded":"2024-06-11T16:03:23.146205+0000","last_fullsized":"2024-06-11T16:03:23.146205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:48:31.343436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":273,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.154860+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:23.154860+0000","last_peered":"2024-06-11T16:03:23.154860+0000","last_clean":"2024-06-11T16:03:23.154860+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:23.154860+0000","last_undegraded":"2024-06-11T16:03:23.154860+0000","last_fullsized":"2024-06-11T16:03:23.154860+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:10:08.358516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145595+0000","last_change":"2024-06-11T16:03:16.189798+0000","last_active":"2024-06-11T16:03:23.145595+0000","last_peered":"2024-06-11T16:03:23.145595+0000","last_clean":"2024-06-11T16:03:23.145595+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:23.145595+0000","last_undegraded":"2024-06-11T16:03:23.145595+0000","last_fullsized":"2024-06-11T16:03:23.145595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:05:30.294094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.155216+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:23.155216+0000","last_peered":"2024-06-11T16:03:23.155216+0000","last_clean":"2024-06-11T16:03:23.155216+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:23.155216+0000","last_undegraded":"2024-06-11T16:03:23.155216+0000","last_fullsized":"2024-06-11T16:03:23.155216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:47.274422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"59'23","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146898+0000","last_change":"2024-06-11T16:03:15.299622+0000","last_active":"2024-06-11T16:03:23.146898+0000","last_peered":"2024-06-11T16:03:23.146898+0000","last_clean":"2024-06-11T16:03:23.146898+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:23.146898+0000","last_undegraded":"2024-06-11T16:03:23.146898+0000","last_fullsized":"2024-06-11T16:03:23.146898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:46:28.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"64'171","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145971+0000","last_change":"2024-06-11T16:03:14.179624+0000","last_active":"2024-06-11T16:03:23.145971+0000","last_peered":"2024-06-11T16:03:23.145971+0000","last_clean":"2024-06-11T16:03:23.145971+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:23.145971+0000","last_undegraded":"2024-06-11T16:03:23.145971+0000","last_fullsized":"2024-06-11T16:03:23.145971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:10:30.816042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149466+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:23.149466+0000","last_peered":"2024-06-11T16:03:23.149466+0000","last_clean":"2024-06-11T16:03:23.149466+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:23.149466+0000","last_undegraded":"2024-06-11T16:03:23.149466+0000","last_fullsized":"2024-06-11T16:03:23.149466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:20:18.809470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145150+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145150+0000","last_peered":"2024-06-11T16:03:23.145150+0000","last_clean":"2024-06-11T16:03:23.145150+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145150+0000","last_undegraded":"2024-06-11T16:03:23.145150+0000","last_fullsized":"2024-06-11T16:03:23.145150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:04:09.365809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"58'7","reported_seq":191,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149555+0000","last_change":"2024-06-11T16:03:15.226576+0000","last_active":"2024-06-11T16:03:23.149555+0000","last_peered":"2024-06-11T16:03:23.149555+0000","last_clean":"2024-06-11T16:03:23.149555+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:23.149555+0000","last_undegraded":"2024-06-11T16:03:23.149555+0000","last_fullsized":"2024-06-11T16:03:23.149555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:24:27.520919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64507904,"data_stored":53213968,"data_compressed":4521573,"data_compressed_allocated":5312512,"data_compressed_original":14032896,"omap_allocated":0,"internal_metadata":0},"log_size":10454,"ondisk_log_size":10454,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678024,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65548,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":35833,"kb_avail":94306292,"statfs":{"total":96636764160,"available":96569643008,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":36692996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81516,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94290324,"statfs":{"total":96636764160,"available":96553291776,"internally_reserved":0,"allocated":24535040,"data_stored":44637238,"data_compressed":5935444,"data_compressed_allocated":7028736,"data_compressed_original":34140160,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84804,"kb_used_data":27252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94287036,"statfs":{"total":96636764160,"available":96549924864,"internally_reserved":0,"allocated":27906048,"data_stored":40733009,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22822912,"data_stored":18900155,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17952768,"data_stored":14154733,"data_compressed":1511042,"data_compressed_allocated":1773568,"data_compressed_original":4550656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:32.006 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.006 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.006 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.007 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.008 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.009 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.010 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.011 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.012 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.013 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.014 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-11T15:58:50.119808+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=50, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.015 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.016 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.017 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.018 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.019 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.020 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.021 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.022 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.023 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:32.023 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-11T16:03:52.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:03:52.327 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:03:52.329 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:03:52.338 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-06-11T16:03:51.652260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12915,"ondisk_log_size":12915,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":244324,"kb_used_data":80908,"kb_used_omap":10,"kb_used_meta":163381,"kb_avail":282871196,"statfs":{"total":289910292480,"available":289660104704,"internally_reserved":0,"allocated":82849792,"data_stored":140373207,"data_compressed":16997465,"data_compressed_allocated":20094976,"data_compressed_original":98934784,"omap_allocated":10353,"internal_metadata":167303055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002997"},"pg_stats":[{"pgid":"4.3f","version":"90'218","reported_seq":333,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.799987+0000","last_change":"2024-06-11T16:03:34.800033+0000","last_active":"2024-06-11T16:03:34.799987+0000","last_peered":"2024-06-11T16:03:34.799987+0000","last_clean":"2024-06-11T16:03:34.799987+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:34.799987+0000","last_undegraded":"2024-06-11T16:03:34.799987+0000","last_fullsized":"2024-06-11T16:03:34.799987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'218","last_scrub_stamp":"2024-06-11T16:03:34.799908+0000","last_deep_scrub":"90'218","last_deep_scrub_stamp":"2024-06-11T16:03:34.799908+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.799908+0000","objects_scrubbed":56,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:16:06.900020+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"64'157","reported_seq":250,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146387+0000","last_change":"2024-06-11T16:03:14.171398+0000","last_active":"2024-06-11T16:03:23.146387+0000","last_peered":"2024-06-11T16:03:23.146387+0000","last_clean":"2024-06-11T16:03:23.146387+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:23.146387+0000","last_undegraded":"2024-06-11T16:03:23.146387+0000","last_fullsized":"2024-06-11T16:03:23.146387+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"90'235","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.753559+0000","last_change":"2024-06-11T16:03:31.753610+0000","last_active":"2024-06-11T16:03:31.753559+0000","last_peered":"2024-06-11T16:03:31.753559+0000","last_clean":"2024-06-11T16:03:31.753559+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:31.753559+0000","last_undegraded":"2024-06-11T16:03:31.753559+0000","last_fullsized":"2024-06-11T16:03:31.753559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'235","last_scrub_stamp":"2024-06-11T16:03:31.753444+0000","last_deep_scrub":"90'235","last_deep_scrub_stamp":"2024-06-11T16:03:31.753444+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.753444+0000","objects_scrubbed":45,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:06.937103+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"90'176","reported_seq":304,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.736813+0000","last_change":"2024-06-11T16:03:33.736864+0000","last_active":"2024-06-11T16:03:33.736813+0000","last_peered":"2024-06-11T16:03:33.736813+0000","last_clean":"2024-06-11T16:03:33.736813+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:33.736813+0000","last_undegraded":"2024-06-11T16:03:33.736813+0000","last_fullsized":"2024-06-11T16:03:33.736813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'176","last_scrub_stamp":"2024-06-11T16:03:33.736732+0000","last_deep_scrub":"90'176","last_deep_scrub_stamp":"2024-06-11T16:03:33.736732+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.736732+0000","objects_scrubbed":47,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:29:49.234470+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"90'243","reported_seq":362,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.890675+0000","last_change":"2024-06-11T16:03:39.890708+0000","last_active":"2024-06-11T16:03:39.890675+0000","last_peered":"2024-06-11T16:03:39.890675+0000","last_clean":"2024-06-11T16:03:39.890675+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:39.890675+0000","last_undegraded":"2024-06-11T16:03:39.890675+0000","last_fullsized":"2024-06-11T16:03:39.890675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'243","last_scrub_stamp":"2024-06-11T16:03:39.890596+0000","last_deep_scrub":"90'243","last_deep_scrub_stamp":"2024-06-11T16:03:39.890596+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.890596+0000","objects_scrubbed":62,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:47.314538+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"90'224","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.893018+0000","last_change":"2024-06-11T16:03:45.893059+0000","last_active":"2024-06-11T16:03:45.893018+0000","last_peered":"2024-06-11T16:03:45.893018+0000","last_clean":"2024-06-11T16:03:45.893018+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:45.893018+0000","last_undegraded":"2024-06-11T16:03:45.893018+0000","last_fullsized":"2024-06-11T16:03:45.893018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'224","last_scrub_stamp":"2024-06-11T16:03:45.892927+0000","last_deep_scrub":"90'224","last_deep_scrub_stamp":"2024-06-11T16:03:45.892927+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.892927+0000","objects_scrubbed":49,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:36:41.086727+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"90'229","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.948174+0000","last_change":"2024-06-11T16:03:47.948243+0000","last_active":"2024-06-11T16:03:47.948174+0000","last_peered":"2024-06-11T16:03:47.948174+0000","last_clean":"2024-06-11T16:03:47.948174+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:47.948174+0000","last_undegraded":"2024-06-11T16:03:47.948174+0000","last_fullsized":"2024-06-11T16:03:47.948174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'229","last_scrub_stamp":"2024-06-11T16:03:47.948082+0000","last_deep_scrub":"90'229","last_deep_scrub_stamp":"2024-06-11T16:03:47.948082+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.948082+0000","objects_scrubbed":61,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:53:44.016564+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"64'132","reported_seq":247,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079335+0000","last_change":"2024-06-11T16:03:21.151098+0000","last_active":"2024-06-11T16:03:24.079335+0000","last_peered":"2024-06-11T16:03:24.079335+0000","last_clean":"2024-06-11T16:03:24.079335+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:03:24.079335+0000","last_undegraded":"2024-06-11T16:03:24.079335+0000","last_fullsized":"2024-06-11T16:03:24.079335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"90'222","reported_seq":388,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.464433+0000","last_change":"2024-06-11T16:03:33.464462+0000","last_active":"2024-06-11T16:03:33.464433+0000","last_peered":"2024-06-11T16:03:33.464433+0000","last_clean":"2024-06-11T16:03:33.464433+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:33.464433+0000","last_undegraded":"2024-06-11T16:03:33.464433+0000","last_fullsized":"2024-06-11T16:03:33.464433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'222","last_scrub_stamp":"2024-06-11T16:03:33.464350+0000","last_deep_scrub":"90'222","last_deep_scrub_stamp":"2024-06-11T16:03:33.464350+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.464350+0000","objects_scrubbed":52,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:49:48.373086+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"90'202","reported_seq":290,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.913279+0000","last_change":"2024-06-11T16:03:42.913359+0000","last_active":"2024-06-11T16:03:42.913279+0000","last_peered":"2024-06-11T16:03:42.913279+0000","last_clean":"2024-06-11T16:03:42.913279+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:42.913279+0000","last_undegraded":"2024-06-11T16:03:42.913279+0000","last_fullsized":"2024-06-11T16:03:42.913279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'202","last_scrub_stamp":"2024-06-11T16:03:42.913182+0000","last_deep_scrub":"90'202","last_deep_scrub_stamp":"2024-06-11T16:03:42.913182+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.913182+0000","objects_scrubbed":42,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:11:29.158862+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"64'155","reported_seq":253,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146488+0000","last_change":"2024-06-11T16:03:16.177703+0000","last_active":"2024-06-11T16:03:23.146488+0000","last_peered":"2024-06-11T16:03:23.146488+0000","last_clean":"2024-06-11T16:03:23.146488+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:23.146488+0000","last_undegraded":"2024-06-11T16:03:23.146488+0000","last_fullsized":"2024-06-11T16:03:23.146488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"64'139","reported_seq":392,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146174+0000","last_change":"2024-06-11T16:03:19.139707+0000","last_active":"2024-06-11T16:03:23.146174+0000","last_peered":"2024-06-11T16:03:23.146174+0000","last_clean":"2024-06-11T16:03:23.146174+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:23.146174+0000","last_undegraded":"2024-06-11T16:03:23.146174+0000","last_fullsized":"2024-06-11T16:03:23.146174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"90'185","reported_seq":298,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.884424+0000","last_change":"2024-06-11T16:03:41.884468+0000","last_active":"2024-06-11T16:03:41.884424+0000","last_peered":"2024-06-11T16:03:41.884424+0000","last_clean":"2024-06-11T16:03:41.884424+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:41.884424+0000","last_undegraded":"2024-06-11T16:03:41.884424+0000","last_fullsized":"2024-06-11T16:03:41.884424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'185","last_scrub_stamp":"2024-06-11T16:03:41.884343+0000","last_deep_scrub":"90'185","last_deep_scrub_stamp":"2024-06-11T16:03:41.884343+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.884343+0000","objects_scrubbed":51,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:40.164710+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"90'217","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.841608+0000","last_change":"2024-06-11T16:03:39.841650+0000","last_active":"2024-06-11T16:03:39.841608+0000","last_peered":"2024-06-11T16:03:39.841608+0000","last_clean":"2024-06-11T16:03:39.841608+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:39.841608+0000","last_undegraded":"2024-06-11T16:03:39.841608+0000","last_fullsized":"2024-06-11T16:03:39.841608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'217","last_scrub_stamp":"2024-06-11T16:03:39.841528+0000","last_deep_scrub":"90'217","last_deep_scrub_stamp":"2024-06-11T16:03:39.841528+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.841528+0000","objects_scrubbed":47,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:14.376531+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"64'172","reported_seq":237,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145093+0000","last_change":"2024-06-11T16:03:18.183580+0000","last_active":"2024-06-11T16:03:23.145093+0000","last_peered":"2024-06-11T16:03:23.145093+0000","last_clean":"2024-06-11T16:03:23.145093+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:23.145093+0000","last_undegraded":"2024-06-11T16:03:23.145093+0000","last_fullsized":"2024-06-11T16:03:23.145093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"90'237","reported_seq":345,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.873469+0000","last_change":"2024-06-11T16:03:40.873504+0000","last_active":"2024-06-11T16:03:40.873469+0000","last_peered":"2024-06-11T16:03:40.873469+0000","last_clean":"2024-06-11T16:03:40.873469+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:40.873469+0000","last_undegraded":"2024-06-11T16:03:40.873469+0000","last_fullsized":"2024-06-11T16:03:40.873469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'237","last_scrub_stamp":"2024-06-11T16:03:40.873374+0000","last_deep_scrub":"90'237","last_deep_scrub_stamp":"2024-06-11T16:03:40.873374+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.873374+0000","objects_scrubbed":59,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:04:30.025773+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"90'210","reported_seq":376,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.445172+0000","last_change":"2024-06-11T16:03:34.445172+0000","last_active":"2024-06-11T16:03:34.445172+0000","last_peered":"2024-06-11T16:03:34.445172+0000","last_clean":"2024-06-11T16:03:34.445172+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:34.445172+0000","last_undegraded":"2024-06-11T16:03:34.445172+0000","last_fullsized":"2024-06-11T16:03:34.445172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'210","last_scrub_stamp":"2024-06-11T16:03:34.445046+0000","last_deep_scrub":"90'210","last_deep_scrub_stamp":"2024-06-11T16:03:34.445046+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.445046+0000","objects_scrubbed":47,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:16:48.215032+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"90'199","reported_seq":293,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.762178+0000","last_change":"2024-06-11T16:03:33.762208+0000","last_active":"2024-06-11T16:03:33.762178+0000","last_peered":"2024-06-11T16:03:33.762178+0000","last_clean":"2024-06-11T16:03:33.762178+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:33.762178+0000","last_undegraded":"2024-06-11T16:03:33.762178+0000","last_fullsized":"2024-06-11T16:03:33.762178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'199","last_scrub_stamp":"2024-06-11T16:03:33.762088+0000","last_deep_scrub":"90'199","last_deep_scrub_stamp":"2024-06-11T16:03:33.762088+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.762088+0000","objects_scrubbed":50,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:38.124306+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"90'198","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.474065+0000","last_change":"2024-06-11T16:03:37.474118+0000","last_active":"2024-06-11T16:03:37.474065+0000","last_peered":"2024-06-11T16:03:37.474065+0000","last_clean":"2024-06-11T16:03:37.474065+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:37.474065+0000","last_undegraded":"2024-06-11T16:03:37.474065+0000","last_fullsized":"2024-06-11T16:03:37.474065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'198","last_scrub_stamp":"2024-06-11T16:03:37.473970+0000","last_deep_scrub":"90'198","last_deep_scrub_stamp":"2024-06-11T16:03:37.473970+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.473970+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:49:33.128895+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"64'185","reported_seq":283,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146048+0000","last_change":"2024-06-11T16:03:16.176287+0000","last_active":"2024-06-11T16:03:23.146048+0000","last_peered":"2024-06-11T16:03:23.146048+0000","last_clean":"2024-06-11T16:03:23.146048+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:23.146048+0000","last_undegraded":"2024-06-11T16:03:23.146048+0000","last_fullsized":"2024-06-11T16:03:23.146048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"90'214","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.794414+0000","last_change":"2024-06-11T16:03:36.794446+0000","last_active":"2024-06-11T16:03:36.794414+0000","last_peered":"2024-06-11T16:03:36.794414+0000","last_clean":"2024-06-11T16:03:36.794414+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:36.794414+0000","last_undegraded":"2024-06-11T16:03:36.794414+0000","last_fullsized":"2024-06-11T16:03:36.794414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:36.794309+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:36.794309+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.794309+0000","objects_scrubbed":55,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:35.567513+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"64'168","reported_seq":449,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145847+0000","last_change":"2024-06-11T16:03:20.142331+0000","last_active":"2024-06-11T16:03:23.145847+0000","last_peered":"2024-06-11T16:03:23.145847+0000","last_clean":"2024-06-11T16:03:23.145847+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:03:23.145847+0000","last_undegraded":"2024-06-11T16:03:23.145847+0000","last_fullsized":"2024-06-11T16:03:23.145847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"64'163","reported_seq":540,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:30.820303+0000","last_change":"2024-06-11T16:03:19.139731+0000","last_active":"2024-06-11T16:03:30.820303+0000","last_peered":"2024-06-11T16:03:30.820303+0000","last_clean":"2024-06-11T16:03:30.820303+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:30.820303+0000","last_undegraded":"2024-06-11T16:03:30.820303+0000","last_fullsized":"2024-06-11T16:03:30.820303+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"90'219","reported_seq":335,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.903414+0000","last_change":"2024-06-11T16:03:44.903442+0000","last_active":"2024-06-11T16:03:44.903414+0000","last_peered":"2024-06-11T16:03:44.903414+0000","last_clean":"2024-06-11T16:03:44.903414+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:44.903414+0000","last_undegraded":"2024-06-11T16:03:44.903414+0000","last_fullsized":"2024-06-11T16:03:44.903414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'219","last_scrub_stamp":"2024-06-11T16:03:44.903335+0000","last_deep_scrub":"90'219","last_deep_scrub_stamp":"2024-06-11T16:03:44.903335+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.903335+0000","objects_scrubbed":52,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:41.010767+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"64'151","reported_seq":431,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146736+0000","last_change":"2024-06-11T16:03:18.183279+0000","last_active":"2024-06-11T16:03:23.146736+0000","last_peered":"2024-06-11T16:03:23.146736+0000","last_clean":"2024-06-11T16:03:23.146736+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:23.146736+0000","last_undegraded":"2024-06-11T16:03:23.146736+0000","last_fullsized":"2024-06-11T16:03:23.146736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"64'198","reported_seq":607,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149361+0000","last_change":"2024-06-11T16:03:21.151146+0000","last_active":"2024-06-11T16:03:23.149361+0000","last_peered":"2024-06-11T16:03:23.149361+0000","last_clean":"2024-06-11T16:03:23.149361+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:03:23.149361+0000","last_undegraded":"2024-06-11T16:03:23.149361+0000","last_fullsized":"2024-06-11T16:03:23.149361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"64'158","reported_seq":216,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079430+0000","last_change":"2024-06-11T16:03:23.150959+0000","last_active":"2024-06-11T16:03:24.079430+0000","last_peered":"2024-06-11T16:03:24.079430+0000","last_clean":"2024-06-11T16:03:24.079430+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:03:24.079430+0000","last_undegraded":"2024-06-11T16:03:24.079430+0000","last_fullsized":"2024-06-11T16:03:24.079430+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"64'149","reported_seq":494,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146575+0000","last_change":"2024-06-11T16:03:04.094166+0000","last_active":"2024-06-11T16:03:23.146575+0000","last_peered":"2024-06-11T16:03:23.146575+0000","last_clean":"2024-06-11T16:03:23.146575+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:23.146575+0000","last_undegraded":"2024-06-11T16:03:23.146575+0000","last_fullsized":"2024-06-11T16:03:23.146575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"90'226","reported_seq":393,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.407432+0000","last_change":"2024-06-11T16:03:43.407469+0000","last_active":"2024-06-11T16:03:43.407432+0000","last_peered":"2024-06-11T16:03:43.407432+0000","last_clean":"2024-06-11T16:03:43.407432+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:43.407432+0000","last_undegraded":"2024-06-11T16:03:43.407432+0000","last_fullsized":"2024-06-11T16:03:43.407432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'226","last_scrub_stamp":"2024-06-11T16:03:43.407354+0000","last_deep_scrub":"90'226","last_deep_scrub_stamp":"2024-06-11T16:03:43.407354+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.407354+0000","objects_scrubbed":60,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:11:00.753181+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"64'186","reported_seq":497,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146553+0000","last_change":"2024-06-11T16:03:22.144028+0000","last_active":"2024-06-11T16:03:23.146553+0000","last_peered":"2024-06-11T16:03:23.146553+0000","last_clean":"2024-06-11T16:03:23.146553+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:03:23.146553+0000","last_undegraded":"2024-06-11T16:03:23.146553+0000","last_fullsized":"2024-06-11T16:03:23.146553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'259","reported_seq":426,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.481119+0000","last_change":"2024-06-11T16:03:35.481159+0000","last_active":"2024-06-11T16:03:35.481119+0000","last_peered":"2024-06-11T16:03:35.481119+0000","last_clean":"2024-06-11T16:03:35.481119+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:35.481119+0000","last_undegraded":"2024-06-11T16:03:35.481119+0000","last_fullsized":"2024-06-11T16:03:35.481119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'259","last_scrub_stamp":"2024-06-11T16:03:35.481040+0000","last_deep_scrub":"90'259","last_deep_scrub_stamp":"2024-06-11T16:03:35.481040+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.481040+0000","objects_scrubbed":66,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:20:12.647916+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"64'191","reported_seq":312,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145001+0000","last_change":"2024-06-11T16:03:18.183556+0000","last_active":"2024-06-11T16:03:23.145001+0000","last_peered":"2024-06-11T16:03:23.145001+0000","last_clean":"2024-06-11T16:03:23.145001+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:23.145001+0000","last_undegraded":"2024-06-11T16:03:23.145001+0000","last_fullsized":"2024-06-11T16:03:23.145001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"90'200","reported_seq":310,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.814600+0000","last_change":"2024-06-11T16:03:37.814655+0000","last_active":"2024-06-11T16:03:37.814600+0000","last_peered":"2024-06-11T16:03:37.814600+0000","last_clean":"2024-06-11T16:03:37.814600+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:37.814600+0000","last_undegraded":"2024-06-11T16:03:37.814600+0000","last_fullsized":"2024-06-11T16:03:37.814600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'200","last_scrub_stamp":"2024-06-11T16:03:37.814513+0000","last_deep_scrub":"90'200","last_deep_scrub_stamp":"2024-06-11T16:03:37.814513+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.814513+0000","objects_scrubbed":45,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:03:50.089718+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"90'125","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.914448+0000","last_change":"2024-06-11T16:03:46.914477+0000","last_active":"2024-06-11T16:03:46.914448+0000","last_peered":"2024-06-11T16:03:46.914448+0000","last_clean":"2024-06-11T16:03:46.914448+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:46.914448+0000","last_undegraded":"2024-06-11T16:03:46.914448+0000","last_fullsized":"2024-06-11T16:03:46.914448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'125","last_scrub_stamp":"2024-06-11T16:03:46.914364+0000","last_deep_scrub":"90'125","last_deep_scrub_stamp":"2024-06-11T16:03:46.914364+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.914364+0000","objects_scrubbed":3,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:09:29.727340+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"90'190","reported_seq":306,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.888820+0000","last_change":"2024-06-11T16:03:46.888869+0000","last_active":"2024-06-11T16:03:46.888820+0000","last_peered":"2024-06-11T16:03:46.888820+0000","last_clean":"2024-06-11T16:03:46.888820+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:46.888820+0000","last_undegraded":"2024-06-11T16:03:46.888820+0000","last_fullsized":"2024-06-11T16:03:46.888820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'190","last_scrub_stamp":"2024-06-11T16:03:46.888740+0000","last_deep_scrub":"90'190","last_deep_scrub_stamp":"2024-06-11T16:03:46.888740+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.888740+0000","objects_scrubbed":47,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:46:46.616571+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.385661+0000","last_change":"2024-06-11T16:03:36.385661+0000","last_active":"2024-06-11T16:03:36.385661+0000","last_peered":"2024-06-11T16:03:36.385661+0000","last_clean":"2024-06-11T16:03:36.385661+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:36.385661+0000","last_undegraded":"2024-06-11T16:03:36.385661+0000","last_fullsized":"2024-06-11T16:03:36.385661+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:36.385493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:36.385493+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.385493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:46:55.902701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'236","reported_seq":637,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.474689+0000","last_change":"2024-06-11T16:03:38.474718+0000","last_active":"2024-06-11T16:03:38.474689+0000","last_peered":"2024-06-11T16:03:38.474689+0000","last_clean":"2024-06-11T16:03:38.474689+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:38.474689+0000","last_undegraded":"2024-06-11T16:03:38.474689+0000","last_fullsized":"2024-06-11T16:03:38.474689+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'236","last_scrub_stamp":"2024-06-11T16:03:38.474609+0000","last_deep_scrub":"90'236","last_deep_scrub_stamp":"2024-06-11T16:03:38.474609+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.474609+0000","objects_scrubbed":56,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:29:45.895183+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.856522+0000","last_change":"2024-06-11T16:03:43.856550+0000","last_active":"2024-06-11T16:03:43.856522+0000","last_peered":"2024-06-11T16:03:43.856522+0000","last_clean":"2024-06-11T16:03:43.856522+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:43.856522+0000","last_undegraded":"2024-06-11T16:03:43.856522+0000","last_fullsized":"2024-06-11T16:03:43.856522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:43.856424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:43.856424+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.856424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:02:20.638989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"90'262","reported_seq":638,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.437221+0000","last_change":"2024-06-11T16:03:40.437298+0000","last_active":"2024-06-11T16:03:40.437221+0000","last_peered":"2024-06-11T16:03:40.437221+0000","last_clean":"2024-06-11T16:03:40.437221+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:40.437221+0000","last_undegraded":"2024-06-11T16:03:40.437221+0000","last_fullsized":"2024-06-11T16:03:40.437221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'262","last_scrub_stamp":"2024-06-11T16:03:40.437138+0000","last_deep_scrub":"90'262","last_deep_scrub_stamp":"2024-06-11T16:03:40.437138+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.437138+0000","objects_scrubbed":49,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:11:49.937628+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"90'13","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.867460+0000","last_change":"2024-06-11T16:03:41.867495+0000","last_active":"2024-06-11T16:03:41.867460+0000","last_peered":"2024-06-11T16:03:41.867460+0000","last_clean":"2024-06-11T16:03:41.867460+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:41.867460+0000","last_undegraded":"2024-06-11T16:03:41.867460+0000","last_fullsized":"2024-06-11T16:03:41.867460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'13","last_scrub_stamp":"2024-06-11T16:03:41.867375+0000","last_deep_scrub":"90'13","last_deep_scrub_stamp":"2024-06-11T16:03:41.867375+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.867375+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:46.477478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145865+0000","last_change":"2024-06-11T16:03:01.081054+0000","last_active":"2024-06-11T16:03:23.145865+0000","last_peered":"2024-06-11T16:03:23.145865+0000","last_clean":"2024-06-11T16:03:23.145865+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:23.145865+0000","last_undegraded":"2024-06-11T16:03:23.145865+0000","last_fullsized":"2024-06-11T16:03:23.145865+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"64'155","reported_seq":497,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145586+0000","last_change":"2024-06-11T16:03:04.094450+0000","last_active":"2024-06-11T16:03:23.145586+0000","last_peered":"2024-06-11T16:03:23.145586+0000","last_clean":"2024-06-11T16:03:23.145586+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:23.145586+0000","last_undegraded":"2024-06-11T16:03:23.145586+0000","last_fullsized":"2024-06-11T16:03:23.145586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'4","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146740+0000","last_change":"2024-06-11T16:03:15.259451+0000","last_active":"2024-06-11T16:03:23.146740+0000","last_peered":"2024-06-11T16:03:23.146740+0000","last_clean":"2024-06-11T16:03:23.146740+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:23.146740+0000","last_undegraded":"2024-06-11T16:03:23.146740+0000","last_fullsized":"2024-06-11T16:03:23.146740+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"90'226","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.854419+0000","last_change":"2024-06-11T16:03:38.854480+0000","last_active":"2024-06-11T16:03:38.854419+0000","last_peered":"2024-06-11T16:03:38.854419+0000","last_clean":"2024-06-11T16:03:38.854419+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:38.854419+0000","last_undegraded":"2024-06-11T16:03:38.854419+0000","last_fullsized":"2024-06-11T16:03:38.854419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'226","last_scrub_stamp":"2024-06-11T16:03:38.854322+0000","last_deep_scrub":"90'226","last_deep_scrub_stamp":"2024-06-11T16:03:38.854322+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.854322+0000","objects_scrubbed":59,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:12:42.139827+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"90'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.888389+0000","last_change":"2024-06-11T16:03:43.888423+0000","last_active":"2024-06-11T16:03:43.888389+0000","last_peered":"2024-06-11T16:03:43.888389+0000","last_clean":"2024-06-11T16:03:43.888389+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:43.888389+0000","last_undegraded":"2024-06-11T16:03:43.888389+0000","last_fullsized":"2024-06-11T16:03:43.888389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-06-11T16:03:43.888252+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-06-11T16:03:43.888252+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.888252+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:28:11.005974+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"64'164","reported_seq":275,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079364+0000","last_change":"2024-06-11T16:03:23.150613+0000","last_active":"2024-06-11T16:03:24.079364+0000","last_peered":"2024-06-11T16:03:24.079364+0000","last_clean":"2024-06-11T16:03:24.079364+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:03:24.079364+0000","last_undegraded":"2024-06-11T16:03:24.079364+0000","last_fullsized":"2024-06-11T16:03:24.079364+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145627+0000","last_change":"2024-06-11T16:03:16.171128+0000","last_active":"2024-06-11T16:03:23.145627+0000","last_peered":"2024-06-11T16:03:23.145627+0000","last_clean":"2024-06-11T16:03:23.145627+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:23.145627+0000","last_undegraded":"2024-06-11T16:03:23.145627+0000","last_fullsized":"2024-06-11T16:03:23.145627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"64'165","reported_seq":544,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:30.820172+0000","last_change":"2024-06-11T16:03:22.143879+0000","last_active":"2024-06-11T16:03:30.820172+0000","last_peered":"2024-06-11T16:03:30.820172+0000","last_clean":"2024-06-11T16:03:30.820172+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:03:30.820172+0000","last_undegraded":"2024-06-11T16:03:30.820172+0000","last_fullsized":"2024-06-11T16:03:30.820172+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"57'12","reported_seq":193,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:28.140473+0000","last_change":"2024-06-11T16:03:15.318917+0000","last_active":"2024-06-11T16:03:28.140473+0000","last_peered":"2024-06-11T16:03:28.140473+0000","last_clean":"2024-06-11T16:03:28.140473+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:28.140473+0000","last_undegraded":"2024-06-11T16:03:28.140473+0000","last_fullsized":"2024-06-11T16:03:28.140473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"90'238","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.782639+0000","last_change":"2024-06-11T16:03:35.782683+0000","last_active":"2024-06-11T16:03:35.782639+0000","last_peered":"2024-06-11T16:03:35.782639+0000","last_clean":"2024-06-11T16:03:35.782639+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:35.782639+0000","last_undegraded":"2024-06-11T16:03:35.782639+0000","last_fullsized":"2024-06-11T16:03:35.782639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'238","last_scrub_stamp":"2024-06-11T16:03:35.782561+0000","last_deep_scrub":"90'238","last_deep_scrub_stamp":"2024-06-11T16:03:35.782561+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.782561+0000","objects_scrubbed":63,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:34:35.500910+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146325+0000","last_change":"2024-06-11T16:03:16.178570+0000","last_active":"2024-06-11T16:03:23.146325+0000","last_peered":"2024-06-11T16:03:23.146325+0000","last_clean":"2024-06-11T16:03:23.146325+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:03:23.146325+0000","last_undegraded":"2024-06-11T16:03:23.146325+0000","last_fullsized":"2024-06-11T16:03:23.146325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"64'164","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079445+0000","last_change":"2024-06-11T16:03:20.150588+0000","last_active":"2024-06-11T16:03:24.079445+0000","last_peered":"2024-06-11T16:03:24.079445+0000","last_clean":"2024-06-11T16:03:24.079445+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:03:24.079445+0000","last_undegraded":"2024-06-11T16:03:24.079445+0000","last_fullsized":"2024-06-11T16:03:24.079445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":138,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146408+0000","last_change":"2024-06-11T16:03:01.078417+0000","last_active":"2024-06-11T16:03:23.146408+0000","last_peered":"2024-06-11T16:03:23.146408+0000","last_clean":"2024-06-11T16:03:23.146408+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:23.146408+0000","last_undegraded":"2024-06-11T16:03:23.146408+0000","last_fullsized":"2024-06-11T16:03:23.146408+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"64'138","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145893+0000","last_change":"2024-06-11T16:03:19.138472+0000","last_active":"2024-06-11T16:03:23.145893+0000","last_peered":"2024-06-11T16:03:23.145893+0000","last_clean":"2024-06-11T16:03:23.145893+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:03:23.145893+0000","last_undegraded":"2024-06-11T16:03:23.145893+0000","last_fullsized":"2024-06-11T16:03:23.145893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":68,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145707+0000","last_change":"2024-06-11T16:03:14.178391+0000","last_active":"2024-06-11T16:03:23.145707+0000","last_peered":"2024-06-11T16:03:23.145707+0000","last_clean":"2024-06-11T16:03:23.145707+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:23.145707+0000","last_undegraded":"2024-06-11T16:03:23.145707+0000","last_fullsized":"2024-06-11T16:03:23.145707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"90'191","reported_seq":357,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.466914+0000","last_change":"2024-06-11T16:03:32.466914+0000","last_active":"2024-06-11T16:03:32.466914+0000","last_peered":"2024-06-11T16:03:32.466914+0000","last_clean":"2024-06-11T16:03:32.466914+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:32.466914+0000","last_undegraded":"2024-06-11T16:03:32.466914+0000","last_fullsized":"2024-06-11T16:03:32.466914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'191","last_scrub_stamp":"2024-06-11T16:03:32.466765+0000","last_deep_scrub":"90'191","last_deep_scrub_stamp":"2024-06-11T16:03:32.466765+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.466765+0000","objects_scrubbed":49,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:28:09.791204+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"90'159","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.735018+0000","last_change":"2024-06-11T16:03:34.735063+0000","last_active":"2024-06-11T16:03:34.735018+0000","last_peered":"2024-06-11T16:03:34.735018+0000","last_clean":"2024-06-11T16:03:34.735018+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:34.735018+0000","last_undegraded":"2024-06-11T16:03:34.735018+0000","last_fullsized":"2024-06-11T16:03:34.735018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'159","last_scrub_stamp":"2024-06-11T16:03:34.734931+0000","last_deep_scrub":"90'159","last_deep_scrub_stamp":"2024-06-11T16:03:34.734931+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.734931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:48:10.330843+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146136+0000","last_change":"2024-06-11T16:03:16.180303+0000","last_active":"2024-06-11T16:03:23.146136+0000","last_peered":"2024-06-11T16:03:23.146136+0000","last_clean":"2024-06-11T16:03:23.146136+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:23.146136+0000","last_undegraded":"2024-06-11T16:03:23.146136+0000","last_fullsized":"2024-06-11T16:03:23.146136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"69'24","reported_seq":183,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148903+0000","last_change":"2024-06-11T15:58:58.177927+0000","last_active":"2024-06-11T16:03:23.148903+0000","last_peered":"2024-06-11T16:03:23.148903+0000","last_clean":"2024-06-11T16:03:23.148903+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:23.148903+0000","last_undegraded":"2024-06-11T16:03:23.148903+0000","last_fullsized":"2024-06-11T16:03:23.148903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"90'207","reported_seq":287,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.799742+0000","last_change":"2024-06-11T16:03:32.799773+0000","last_active":"2024-06-11T16:03:32.799742+0000","last_peered":"2024-06-11T16:03:32.799742+0000","last_clean":"2024-06-11T16:03:32.799742+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:32.799742+0000","last_undegraded":"2024-06-11T16:03:32.799742+0000","last_fullsized":"2024-06-11T16:03:32.799742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'207","last_scrub_stamp":"2024-06-11T16:03:32.799651+0000","last_deep_scrub":"90'207","last_deep_scrub_stamp":"2024-06-11T16:03:32.799651+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.799651+0000","objects_scrubbed":58,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:09:13.311267+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.827394+0000","last_change":"2024-06-11T16:03:38.827436+0000","last_active":"2024-06-11T16:03:38.827394+0000","last_peered":"2024-06-11T16:03:38.827394+0000","last_clean":"2024-06-11T16:03:38.827394+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:38.827394+0000","last_undegraded":"2024-06-11T16:03:38.827394+0000","last_fullsized":"2024-06-11T16:03:38.827394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:38.827280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:38.827280+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.827280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:43.261464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"90'39","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.397394+0000","last_change":"2024-06-11T16:03:31.397437+0000","last_active":"2024-06-11T16:03:31.397394+0000","last_peered":"2024-06-11T16:03:31.397394+0000","last_clean":"2024-06-11T16:03:31.397394+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:31.397394+0000","last_undegraded":"2024-06-11T16:03:31.397394+0000","last_fullsized":"2024-06-11T16:03:31.397394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'39","last_scrub_stamp":"2024-06-11T16:03:31.397303+0000","last_deep_scrub":"90'39","last_deep_scrub_stamp":"2024-06-11T16:03:31.397303+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.397303+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:46:56.718295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"90'217","reported_seq":332,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.797280+0000","last_change":"2024-06-11T16:03:35.797310+0000","last_active":"2024-06-11T16:03:35.797280+0000","last_peered":"2024-06-11T16:03:35.797280+0000","last_clean":"2024-06-11T16:03:35.797280+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:35.797280+0000","last_undegraded":"2024-06-11T16:03:35.797280+0000","last_fullsized":"2024-06-11T16:03:35.797280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'217","last_scrub_stamp":"2024-06-11T16:03:35.797197+0000","last_deep_scrub":"90'217","last_deep_scrub_stamp":"2024-06-11T16:03:35.797197+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.797197+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:54:41.599319+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148698+0000","last_change":"2024-06-11T15:58:56.162467+0000","last_active":"2024-06-11T16:03:23.148698+0000","last_peered":"2024-06-11T16:03:23.148698+0000","last_clean":"2024-06-11T16:03:23.148698+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:23.148698+0000","last_undegraded":"2024-06-11T16:03:23.148698+0000","last_fullsized":"2024-06-11T16:03:23.148698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"90'66","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.853554+0000","last_change":"2024-06-11T16:03:45.853585+0000","last_active":"2024-06-11T16:03:45.853554+0000","last_peered":"2024-06-11T16:03:45.853554+0000","last_clean":"2024-06-11T16:03:45.853554+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:45.853554+0000","last_undegraded":"2024-06-11T16:03:45.853554+0000","last_fullsized":"2024-06-11T16:03:45.853554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'66","last_scrub_stamp":"2024-06-11T16:03:45.853450+0000","last_deep_scrub":"90'66","last_deep_scrub_stamp":"2024-06-11T16:03:45.853450+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.853450+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:41.219083+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"90'224","reported_seq":391,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.439655+0000","last_change":"2024-06-11T16:03:39.439688+0000","last_active":"2024-06-11T16:03:39.439655+0000","last_peered":"2024-06-11T16:03:39.439655+0000","last_clean":"2024-06-11T16:03:39.439655+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:39.439655+0000","last_undegraded":"2024-06-11T16:03:39.439655+0000","last_fullsized":"2024-06-11T16:03:39.439655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'224","last_scrub_stamp":"2024-06-11T16:03:39.439556+0000","last_deep_scrub":"90'224","last_deep_scrub_stamp":"2024-06-11T16:03:39.439556+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.439556+0000","objects_scrubbed":55,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:17.880817+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146217+0000","last_change":"2024-06-11T16:03:16.178322+0000","last_active":"2024-06-11T16:03:23.146217+0000","last_peered":"2024-06-11T16:03:23.146217+0000","last_clean":"2024-06-11T16:03:23.146217+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:23.146217+0000","last_undegraded":"2024-06-11T16:03:23.146217+0000","last_fullsized":"2024-06-11T16:03:23.146217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:48.943327+0000","last_change":"2024-06-11T16:03:48.943352+0000","last_active":"2024-06-11T16:03:48.943327+0000","last_peered":"2024-06-11T16:03:48.943327+0000","last_clean":"2024-06-11T16:03:48.943327+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:48.943327+0000","last_undegraded":"2024-06-11T16:03:48.943327+0000","last_fullsized":"2024-06-11T16:03:48.943327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:48.943235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:48.943235+0000","last_clean_scrub_stamp":"2024-06-11T16:03:48.943235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:10:17.774491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"90'213","reported_seq":380,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.373287+0000","last_change":"2024-06-11T16:03:47.373324+0000","last_active":"2024-06-11T16:03:47.373287+0000","last_peered":"2024-06-11T16:03:47.373287+0000","last_clean":"2024-06-11T16:03:47.373287+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:47.373287+0000","last_undegraded":"2024-06-11T16:03:47.373287+0000","last_fullsized":"2024-06-11T16:03:47.373287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'213","last_scrub_stamp":"2024-06-11T16:03:47.373190+0000","last_deep_scrub":"90'213","last_deep_scrub_stamp":"2024-06-11T16:03:47.373190+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.373190+0000","objects_scrubbed":61,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:20.184948+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146180+0000","last_change":"2024-06-11T16:03:16.180330+0000","last_active":"2024-06-11T16:03:23.146180+0000","last_peered":"2024-06-11T16:03:23.146180+0000","last_clean":"2024-06-11T16:03:23.146180+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:23.146180+0000","last_undegraded":"2024-06-11T16:03:23.146180+0000","last_fullsized":"2024-06-11T16:03:23.146180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149446+0000","last_change":"2024-06-11T15:58:56.162389+0000","last_active":"2024-06-11T16:03:23.149446+0000","last_peered":"2024-06-11T16:03:23.149446+0000","last_clean":"2024-06-11T16:03:23.149446+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:23.149446+0000","last_undegraded":"2024-06-11T16:03:23.149446+0000","last_fullsized":"2024-06-11T16:03:23.149446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"64'160","reported_seq":419,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146038+0000","last_change":"2024-06-11T16:03:21.151442+0000","last_active":"2024-06-11T16:03:23.146038+0000","last_peered":"2024-06-11T16:03:23.146038+0000","last_clean":"2024-06-11T16:03:23.146038+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:03:23.146038+0000","last_undegraded":"2024-06-11T16:03:23.146038+0000","last_fullsized":"2024-06-11T16:03:23.146038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":159,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149315+0000","last_change":"2024-06-11T15:58:58.177881+0000","last_active":"2024-06-11T16:03:23.149315+0000","last_peered":"2024-06-11T16:03:23.149315+0000","last_clean":"2024-06-11T16:03:23.149315+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:23.149315+0000","last_undegraded":"2024-06-11T16:03:23.149315+0000","last_fullsized":"2024-06-11T16:03:23.149315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.147078+0000","last_change":"2024-06-11T16:03:14.178072+0000","last_active":"2024-06-11T16:03:23.147078+0000","last_peered":"2024-06-11T16:03:23.147078+0000","last_clean":"2024-06-11T16:03:23.147078+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:23.147078+0000","last_undegraded":"2024-06-11T16:03:23.147078+0000","last_fullsized":"2024-06-11T16:03:23.147078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"64'180","reported_seq":478,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146147+0000","last_change":"2024-06-11T16:03:21.151464+0000","last_active":"2024-06-11T16:03:23.146147+0000","last_peered":"2024-06-11T16:03:23.146147+0000","last_clean":"2024-06-11T16:03:23.146147+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:03:23.146147+0000","last_undegraded":"2024-06-11T16:03:23.146147+0000","last_fullsized":"2024-06-11T16:03:23.146147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149823+0000","last_change":"2024-06-11T15:58:58.177919+0000","last_active":"2024-06-11T16:03:23.149823+0000","last_peered":"2024-06-11T16:03:23.149823+0000","last_clean":"2024-06-11T16:03:23.149823+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:23.149823+0000","last_undegraded":"2024-06-11T16:03:23.149823+0000","last_fullsized":"2024-06-11T16:03:23.149823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149731+0000","last_change":"2024-06-11T15:58:56.162376+0000","last_active":"2024-06-11T16:03:23.149731+0000","last_peered":"2024-06-11T16:03:23.149731+0000","last_clean":"2024-06-11T16:03:23.149731+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:23.149731+0000","last_undegraded":"2024-06-11T16:03:23.149731+0000","last_fullsized":"2024-06-11T16:03:23.149731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"64'147","reported_seq":514,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.148395+0000","last_change":"2024-06-11T16:03:22.143400+0000","last_active":"2024-06-11T16:03:23.148395+0000","last_peered":"2024-06-11T16:03:23.148395+0000","last_clean":"2024-06-11T16:03:23.148395+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:03:23.148395+0000","last_undegraded":"2024-06-11T16:03:23.148395+0000","last_fullsized":"2024-06-11T16:03:23.148395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"64'36","reported_seq":215,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149646+0000","last_change":"2024-06-11T16:03:15.255496+0000","last_active":"2024-06-11T16:03:23.149646+0000","last_peered":"2024-06-11T16:03:23.149646+0000","last_clean":"2024-06-11T16:03:23.149646+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:23.149646+0000","last_undegraded":"2024-06-11T16:03:23.149646+0000","last_fullsized":"2024-06-11T16:03:23.149646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145720+0000","last_change":"2024-06-11T16:03:16.167444+0000","last_active":"2024-06-11T16:03:23.145720+0000","last_peered":"2024-06-11T16:03:23.145720+0000","last_clean":"2024-06-11T16:03:23.145720+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:23.145720+0000","last_undegraded":"2024-06-11T16:03:23.145720+0000","last_fullsized":"2024-06-11T16:03:23.145720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:55.147970+0000","last_clean_scrub_stamp":"2024-06-11T15:58:55.147970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"90'193","reported_seq":465,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.768110+0000","last_change":"2024-06-11T16:03:31.768141+0000","last_active":"2024-06-11T16:03:31.768110+0000","last_peered":"2024-06-11T16:03:31.768110+0000","last_clean":"2024-06-11T16:03:31.768110+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:31.768110+0000","last_undegraded":"2024-06-11T16:03:31.768110+0000","last_fullsized":"2024-06-11T16:03:31.768110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'193","last_scrub_stamp":"2024-06-11T16:03:31.768031+0000","last_deep_scrub":"90'193","last_deep_scrub_stamp":"2024-06-11T16:03:31.768031+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.768031+0000","objects_scrubbed":56,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:08:20.180973+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"64'162","reported_seq":212,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079388+0000","last_change":"2024-06-11T16:03:21.152487+0000","last_active":"2024-06-11T16:03:24.079388+0000","last_peered":"2024-06-11T16:03:24.079388+0000","last_clean":"2024-06-11T16:03:24.079388+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:03:24.079388+0000","last_undegraded":"2024-06-11T16:03:24.079388+0000","last_fullsized":"2024-06-11T16:03:24.079388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"90'55","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.853286+0000","last_change":"2024-06-11T16:03:44.853361+0000","last_active":"2024-06-11T16:03:44.853286+0000","last_peered":"2024-06-11T16:03:44.853286+0000","last_clean":"2024-06-11T16:03:44.853286+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:44.853286+0000","last_undegraded":"2024-06-11T16:03:44.853286+0000","last_fullsized":"2024-06-11T16:03:44.853286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'55","last_scrub_stamp":"2024-06-11T16:03:44.853199+0000","last_deep_scrub":"90'55","last_deep_scrub_stamp":"2024-06-11T16:03:44.853199+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.853199+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:12:52.557662+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"90'198","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.421132+0000","last_change":"2024-06-11T16:03:45.421199+0000","last_active":"2024-06-11T16:03:45.421132+0000","last_peered":"2024-06-11T16:03:45.421132+0000","last_clean":"2024-06-11T16:03:45.421132+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:45.421132+0000","last_undegraded":"2024-06-11T16:03:45.421132+0000","last_fullsized":"2024-06-11T16:03:45.421132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'198","last_scrub_stamp":"2024-06-11T16:03:45.421035+0000","last_deep_scrub":"90'198","last_deep_scrub_stamp":"2024-06-11T16:03:45.421035+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.421035+0000","objects_scrubbed":53,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:26:24.518624+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"63'23","reported_seq":183,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.251566+0000","last_change":"2024-06-11T16:03:01.083356+0000","last_active":"2024-06-11T16:03:31.251566+0000","last_peered":"2024-06-11T16:03:31.251566+0000","last_clean":"2024-06-11T16:03:31.251566+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:31.251566+0000","last_undegraded":"2024-06-11T16:03:31.251566+0000","last_fullsized":"2024-06-11T16:03:31.251566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.869681+0000","last_change":"2024-06-11T16:03:42.869707+0000","last_active":"2024-06-11T16:03:42.869681+0000","last_peered":"2024-06-11T16:03:42.869681+0000","last_clean":"2024-06-11T16:03:42.869681+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:42.869681+0000","last_undegraded":"2024-06-11T16:03:42.869681+0000","last_fullsized":"2024-06-11T16:03:42.869681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-06-11T16:03:42.869589+0000","last_deep_scrub":"59'1","last_deep_scrub_stamp":"2024-06-11T16:03:42.869589+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.869589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:31:47.517379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"64'176","reported_seq":579,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:30.820221+0000","last_change":"2024-06-11T16:03:20.144343+0000","last_active":"2024-06-11T16:03:30.820221+0000","last_peered":"2024-06-11T16:03:30.820221+0000","last_clean":"2024-06-11T16:03:30.820221+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:03:30.820221+0000","last_undegraded":"2024-06-11T16:03:30.820221+0000","last_fullsized":"2024-06-11T16:03:30.820221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.368146+0000","last_change":"2024-06-11T16:03:42.368146+0000","last_active":"2024-06-11T16:03:42.368146+0000","last_peered":"2024-06-11T16:03:42.368146+0000","last_clean":"2024-06-11T16:03:42.368146+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:42.368146+0000","last_undegraded":"2024-06-11T16:03:42.368146+0000","last_fullsized":"2024-06-11T16:03:42.368146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-06-11T16:03:42.368010+0000","last_deep_scrub":"55'1","last_deep_scrub_stamp":"2024-06-11T16:03:42.368010+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.368010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:46.808720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"90'214","reported_seq":381,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.457863+0000","last_change":"2024-06-11T16:03:41.457863+0000","last_active":"2024-06-11T16:03:41.457863+0000","last_peered":"2024-06-11T16:03:41.457863+0000","last_clean":"2024-06-11T16:03:41.457863+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:41.457863+0000","last_undegraded":"2024-06-11T16:03:41.457863+0000","last_fullsized":"2024-06-11T16:03:41.457863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:41.457738+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:41.457738+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.457738+0000","objects_scrubbed":57,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:05.123165+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"64'173","reported_seq":512,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146779+0000","last_change":"2024-06-11T16:03:14.162872+0000","last_active":"2024-06-11T16:03:23.146779+0000","last_peered":"2024-06-11T16:03:23.146779+0000","last_clean":"2024-06-11T16:03:23.146779+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:23.146779+0000","last_undegraded":"2024-06-11T16:03:23.146779+0000","last_fullsized":"2024-06-11T16:03:23.146779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:30.819940+0000","last_change":"2024-06-11T15:58:58.177056+0000","last_active":"2024-06-11T16:03:30.819940+0000","last_peered":"2024-06-11T16:03:30.819940+0000","last_clean":"2024-06-11T16:03:30.819940+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:30.819940+0000","last_undegraded":"2024-06-11T16:03:30.819940+0000","last_fullsized":"2024-06-11T16:03:30.819940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"64'155","reported_seq":524,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149407+0000","last_change":"2024-06-11T16:03:19.139376+0000","last_active":"2024-06-11T16:03:23.149407+0000","last_peered":"2024-06-11T16:03:23.149407+0000","last_clean":"2024-06-11T16:03:23.149407+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:23.149407+0000","last_undegraded":"2024-06-11T16:03:23.149407+0000","last_fullsized":"2024-06-11T16:03:23.149407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":179,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.341968+0000","last_change":"2024-06-11T16:03:44.341968+0000","last_active":"2024-06-11T16:03:44.341968+0000","last_peered":"2024-06-11T16:03:44.341968+0000","last_clean":"2024-06-11T16:03:44.341968+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:44.341968+0000","last_undegraded":"2024-06-11T16:03:44.341968+0000","last_fullsized":"2024-06-11T16:03:44.341968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:44.341829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:44.341829+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.341829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:17.276224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"64'156","reported_seq":416,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146818+0000","last_change":"2024-06-11T16:03:22.145204+0000","last_active":"2024-06-11T16:03:23.146818+0000","last_peered":"2024-06-11T16:03:23.146818+0000","last_clean":"2024-06-11T16:03:23.146818+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:03:23.146818+0000","last_undegraded":"2024-06-11T16:03:23.146818+0000","last_fullsized":"2024-06-11T16:03:23.146818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"58'4","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.146753+0000","last_change":"2024-06-11T16:03:14.168438+0000","last_active":"2024-06-11T16:03:23.146753+0000","last_peered":"2024-06-11T16:03:23.146753+0000","last_clean":"2024-06-11T16:03:23.146753+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:23.146753+0000","last_undegraded":"2024-06-11T16:03:23.146753+0000","last_fullsized":"2024-06-11T16:03:23.146753+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"90'221","reported_seq":339,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.839696+0000","last_change":"2024-06-11T16:03:36.839740+0000","last_active":"2024-06-11T16:03:36.839696+0000","last_peered":"2024-06-11T16:03:36.839696+0000","last_clean":"2024-06-11T16:03:36.839696+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:36.839696+0000","last_undegraded":"2024-06-11T16:03:36.839696+0000","last_fullsized":"2024-06-11T16:03:36.839696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'221","last_scrub_stamp":"2024-06-11T16:03:36.839605+0000","last_deep_scrub":"90'221","last_deep_scrub_stamp":"2024-06-11T16:03:36.839605+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.839605+0000","objects_scrubbed":62,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:32.206657+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"90'7","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.828106+0000","last_change":"2024-06-11T16:03:47.828138+0000","last_active":"2024-06-11T16:03:47.828106+0000","last_peered":"2024-06-11T16:03:47.828106+0000","last_clean":"2024-06-11T16:03:47.828106+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:47.828106+0000","last_undegraded":"2024-06-11T16:03:47.828106+0000","last_fullsized":"2024-06-11T16:03:47.828106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'7","last_scrub_stamp":"2024-06-11T16:03:47.827999+0000","last_deep_scrub":"90'7","last_deep_scrub_stamp":"2024-06-11T16:03:47.827999+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.827999+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:36.282753+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"64'163","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079401+0000","last_change":"2024-06-11T16:03:23.151068+0000","last_active":"2024-06-11T16:03:24.079401+0000","last_peered":"2024-06-11T16:03:24.079401+0000","last_clean":"2024-06-11T16:03:24.079401+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:03:24.079401+0000","last_undegraded":"2024-06-11T16:03:24.079401+0000","last_fullsized":"2024-06-11T16:03:24.079401+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"90'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.796175+0000","last_change":"2024-06-11T16:03:37.796214+0000","last_active":"2024-06-11T16:03:37.796175+0000","last_peered":"2024-06-11T16:03:37.796175+0000","last_clean":"2024-06-11T16:03:37.796175+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:37.796175+0000","last_undegraded":"2024-06-11T16:03:37.796175+0000","last_fullsized":"2024-06-11T16:03:37.796175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-06-11T16:03:37.796085+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-06-11T16:03:37.796085+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.796085+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:10:30.985749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"64'161","reported_seq":272,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:24.079377+0000","last_change":"2024-06-11T16:03:23.153044+0000","last_active":"2024-06-11T16:03:24.079377+0000","last_peered":"2024-06-11T16:03:24.079377+0000","last_clean":"2024-06-11T16:03:24.079377+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:03:24.079377+0000","last_undegraded":"2024-06-11T16:03:24.079377+0000","last_fullsized":"2024-06-11T16:03:24.079377+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"90'26","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.746062+0000","last_change":"2024-06-11T16:03:32.746093+0000","last_active":"2024-06-11T16:03:32.746062+0000","last_peered":"2024-06-11T16:03:32.746062+0000","last_clean":"2024-06-11T16:03:32.746062+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:32.746062+0000","last_undegraded":"2024-06-11T16:03:32.746062+0000","last_fullsized":"2024-06-11T16:03:32.746062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'26","last_scrub_stamp":"2024-06-11T16:03:32.745935+0000","last_deep_scrub":"90'26","last_deep_scrub_stamp":"2024-06-11T16:03:32.745935+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.745935+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:28:01.198525+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"90'234","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.888484+0000","last_change":"2024-06-11T16:03:40.888522+0000","last_active":"2024-06-11T16:03:40.888484+0000","last_peered":"2024-06-11T16:03:40.888484+0000","last_clean":"2024-06-11T16:03:40.888484+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:40.888484+0000","last_undegraded":"2024-06-11T16:03:40.888484+0000","last_fullsized":"2024-06-11T16:03:40.888484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'234","last_scrub_stamp":"2024-06-11T16:03:40.888400+0000","last_deep_scrub":"90'234","last_deep_scrub_stamp":"2024-06-11T16:03:40.888400+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.888400+0000","objects_scrubbed":63,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:22.791650+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"58'3","reported_seq":162,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.149531+0000","last_change":"2024-06-11T15:58:58.178072+0000","last_active":"2024-06-11T16:03:23.149531+0000","last_peered":"2024-06-11T16:03:23.149531+0000","last_clean":"2024-06-11T16:03:23.149531+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:23.149531+0000","last_undegraded":"2024-06-11T16:03:23.149531+0000","last_fullsized":"2024-06-11T16:03:23.149531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:57.155352+0000","last_clean_scrub_stamp":"2024-06-11T15:58:57.155352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"64'195","reported_seq":308,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:23.145297+0000","last_change":"2024-06-11T16:03:04.097339+0000","last_active":"2024-06-11T16:03:23.145297+0000","last_peered":"2024-06-11T16:03:23.145297+0000","last_clean":"2024-06-11T16:03:23.145297+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:23.145297+0000","last_undegraded":"2024-06-11T16:03:23.145297+0000","last_fullsized":"2024-06-11T16:03:23.145297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T15:58:58.156618+0000","last_clean_scrub_stamp":"2024-06-11T15:58:58.156618+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"90'10","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.366241+0000","last_change":"2024-06-11T16:03:46.366277+0000","last_active":"2024-06-11T16:03:46.366241+0000","last_peered":"2024-06-11T16:03:46.366241+0000","last_clean":"2024-06-11T16:03:46.366241+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:46.366241+0000","last_undegraded":"2024-06-11T16:03:46.366241+0000","last_fullsized":"2024-06-11T16:03:46.366241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-06-11T16:03:46.366121+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-06-11T16:03:46.366121+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.366121+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:34:02.515961+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64507904,"data_stored":53213968,"data_compressed":4521573,"data_compressed_allocated":5312512,"data_compressed_original":14032896,"omap_allocated":0,"internal_metadata":0},"log_size":12295,"ondisk_log_size":12295,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":461,"ondisk_log_size":461,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678028,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69704,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94302136,"statfs":{"total":96636764160,"available":96565387264,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":40952836},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85664,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94286176,"statfs":{"total":96636764160,"available":96549044224,"internally_reserved":0,"allocated":24535040,"data_stored":44637238,"data_compressed":5935444,"data_compressed_allocated":7028736,"data_compressed_original":34140160,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88956,"kb_used_data":27252,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94282884,"statfs":{"total":96636764160,"available":96545673216,"internally_reserved":0,"allocated":27906048,"data_stored":40733009,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22822912,"data_stored":18900155,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17952768,"data_stored":14154733,"data_compressed":1511042,"data_compressed_allocated":1773568,"data_compressed_original":4550656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:03:52.342 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.343 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.343 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.343 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.343 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.344 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.345 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.345 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.345 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.345 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.345 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.346 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.347 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.347 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.347 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.347 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.347 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.348 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.348 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.348 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.348 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.348 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.349 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.350 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.350 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.350 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-06-11T15:58:55.147970+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=55, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.350 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.350 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.351 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.352 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.352 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.352 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-06-11T15:58:57.155352+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=57, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.352 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-06-11T15:58:58.156618+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=15, tm_min=58, tm_sec=58, tm_wday=1, tm_yday=163, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=11, tm_hour=16, tm_min=3, tm_sec=29, tm_wday=1, tm_yday=163, tm_isdst=0) 2024-06-11T16:03:52.352 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-11T16:04:12.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-11T16:04:12.652 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:04:12.654 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-06-11T16:04:12.666 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-06-11T16:04:11.657267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69803379,"num_objects":3484,"num_object_clones":0,"num_object_copies":6968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3484,"num_whiteouts":0,"num_read":172,"num_read_kb":465,"num_write":11312,"num_write_kb":84700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3966,"num_bytes_recovered":46281642,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14534,"ondisk_log_size":14534,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":211044,"kb_used_data":80908,"kb_used_omap":10,"kb_used_meta":130101,"kb_avail":282904476,"statfs":{"total":289910292480,"available":289694183424,"internally_reserved":0,"allocated":82849792,"data_stored":140373207,"data_compressed":16997465,"data_compressed_allocated":20094976,"data_compressed_original":98934784,"omap_allocated":10353,"internal_metadata":133224335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003065"},"pg_stats":[{"pgid":"4.3f","version":"90'218","reported_seq":333,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.799987+0000","last_change":"2024-06-11T16:03:34.800033+0000","last_active":"2024-06-11T16:03:34.799987+0000","last_peered":"2024-06-11T16:03:34.799987+0000","last_clean":"2024-06-11T16:03:34.799987+0000","last_became_active":"2024-06-11T16:03:14.178565+0000","last_became_peered":"2024-06-11T16:03:14.178565+0000","last_unstale":"2024-06-11T16:03:34.799987+0000","last_undegraded":"2024-06-11T16:03:34.799987+0000","last_fullsized":"2024-06-11T16:03:34.799987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'218","last_scrub_stamp":"2024-06-11T16:03:34.799908+0000","last_deep_scrub":"90'218","last_deep_scrub_stamp":"2024-06-11T16:03:34.799908+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.799908+0000","objects_scrubbed":56,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:16:06.900020+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95047,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"90'207","reported_seq":310,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:55.864862+0000","last_change":"2024-06-11T16:03:55.864919+0000","last_active":"2024-06-11T16:03:55.864862+0000","last_peered":"2024-06-11T16:03:55.864862+0000","last_clean":"2024-06-11T16:03:55.864862+0000","last_became_active":"2024-06-11T16:03:14.170806+0000","last_became_peered":"2024-06-11T16:03:14.170806+0000","last_unstale":"2024-06-11T16:03:55.864862+0000","last_undegraded":"2024-06-11T16:03:55.864862+0000","last_fullsized":"2024-06-11T16:03:55.864862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'207","last_scrub_stamp":"2024-06-11T16:03:55.864750+0000","last_deep_scrub":"90'207","last_deep_scrub_stamp":"2024-06-11T16:03:55.864750+0000","last_clean_scrub_stamp":"2024-06-11T16:03:55.864750+0000","objects_scrubbed":50,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:24.764103+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284892,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"90'235","reported_seq":307,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.753559+0000","last_change":"2024-06-11T16:03:31.753610+0000","last_active":"2024-06-11T16:03:31.753559+0000","last_peered":"2024-06-11T16:03:31.753559+0000","last_clean":"2024-06-11T16:03:31.753559+0000","last_became_active":"2024-06-11T16:03:19.140408+0000","last_became_peered":"2024-06-11T16:03:19.140408+0000","last_unstale":"2024-06-11T16:03:31.753559+0000","last_undegraded":"2024-06-11T16:03:31.753559+0000","last_fullsized":"2024-06-11T16:03:31.753559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'235","last_scrub_stamp":"2024-06-11T16:03:31.753444+0000","last_deep_scrub":"90'235","last_deep_scrub_stamp":"2024-06-11T16:03:31.753444+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.753444+0000","objects_scrubbed":45,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:39:06.937103+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127546,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127546,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"90'176","reported_seq":304,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.736813+0000","last_change":"2024-06-11T16:03:33.736864+0000","last_active":"2024-06-11T16:03:33.736813+0000","last_peered":"2024-06-11T16:03:33.736813+0000","last_clean":"2024-06-11T16:03:33.736813+0000","last_became_active":"2024-06-11T16:03:19.139099+0000","last_became_peered":"2024-06-11T16:03:19.139099+0000","last_unstale":"2024-06-11T16:03:33.736813+0000","last_undegraded":"2024-06-11T16:03:33.736813+0000","last_fullsized":"2024-06-11T16:03:33.736813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'176","last_scrub_stamp":"2024-06-11T16:03:33.736732+0000","last_deep_scrub":"90'176","last_deep_scrub_stamp":"2024-06-11T16:03:33.736732+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.736732+0000","objects_scrubbed":47,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:29:49.234470+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87203,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":87203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"90'243","reported_seq":362,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.890675+0000","last_change":"2024-06-11T16:03:39.890708+0000","last_active":"2024-06-11T16:03:39.890675+0000","last_peered":"2024-06-11T16:03:39.890675+0000","last_clean":"2024-06-11T16:03:39.890675+0000","last_became_active":"2024-06-11T16:03:14.180455+0000","last_became_peered":"2024-06-11T16:03:14.180455+0000","last_unstale":"2024-06-11T16:03:39.890675+0000","last_undegraded":"2024-06-11T16:03:39.890675+0000","last_fullsized":"2024-06-11T16:03:39.890675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'243","last_scrub_stamp":"2024-06-11T16:03:39.890596+0000","last_deep_scrub":"90'243","last_deep_scrub_stamp":"2024-06-11T16:03:39.890596+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.890596+0000","objects_scrubbed":62,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:13:47.314538+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177180,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"90'224","reported_seq":354,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.893018+0000","last_change":"2024-06-11T16:03:45.893059+0000","last_active":"2024-06-11T16:03:45.893018+0000","last_peered":"2024-06-11T16:03:45.893018+0000","last_clean":"2024-06-11T16:03:45.893018+0000","last_became_active":"2024-06-11T16:03:18.181079+0000","last_became_peered":"2024-06-11T16:03:18.181079+0000","last_unstale":"2024-06-11T16:03:45.893018+0000","last_undegraded":"2024-06-11T16:03:45.893018+0000","last_fullsized":"2024-06-11T16:03:45.893018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'224","last_scrub_stamp":"2024-06-11T16:03:45.892927+0000","last_deep_scrub":"90'224","last_deep_scrub_stamp":"2024-06-11T16:03:45.892927+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.892927+0000","objects_scrubbed":49,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:36:41.086727+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144804,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":144804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"90'229","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.948174+0000","last_change":"2024-06-11T16:03:47.948243+0000","last_active":"2024-06-11T16:03:47.948174+0000","last_peered":"2024-06-11T16:03:47.948174+0000","last_clean":"2024-06-11T16:03:47.948174+0000","last_became_active":"2024-06-11T16:03:18.181309+0000","last_became_peered":"2024-06-11T16:03:18.181309+0000","last_unstale":"2024-06-11T16:03:47.948174+0000","last_undegraded":"2024-06-11T16:03:47.948174+0000","last_fullsized":"2024-06-11T16:03:47.948174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'229","last_scrub_stamp":"2024-06-11T16:03:47.948082+0000","last_deep_scrub":"90'229","last_deep_scrub_stamp":"2024-06-11T16:03:47.948082+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.948082+0000","objects_scrubbed":61,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:53:44.016564+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125490,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":125438,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"90'178","reported_seq":302,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:04.047980+0000","last_change":"2024-06-11T16:04:04.048026+0000","last_active":"2024-06-11T16:04:04.047980+0000","last_peered":"2024-06-11T16:04:04.047980+0000","last_clean":"2024-06-11T16:04:04.047980+0000","last_became_active":"2024-06-11T16:03:21.150317+0000","last_became_peered":"2024-06-11T16:03:21.150317+0000","last_unstale":"2024-06-11T16:04:04.047980+0000","last_undegraded":"2024-06-11T16:04:04.047980+0000","last_fullsized":"2024-06-11T16:04:04.047980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'178","last_scrub_stamp":"2024-06-11T16:04:04.047906+0000","last_deep_scrub":"90'178","last_deep_scrub_stamp":"2024-06-11T16:04:04.047906+0000","last_clean_scrub_stamp":"2024-06-11T16:04:04.047906+0000","objects_scrubbed":46,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:31:03.022717+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134620,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":126628,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"90'222","reported_seq":389,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.464462+0000","last_change":"2024-06-11T16:03:33.464462+0000","last_active":"2024-06-11T16:03:33.464462+0000","last_peered":"2024-06-11T16:03:33.464462+0000","last_clean":"2024-06-11T16:03:33.464462+0000","last_became_active":"2024-06-11T15:58:59.196748+0000","last_became_peered":"2024-06-11T15:58:59.196748+0000","last_unstale":"2024-06-11T16:03:33.464462+0000","last_undegraded":"2024-06-11T16:03:33.464462+0000","last_fullsized":"2024-06-11T16:03:33.464462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'222","last_scrub_stamp":"2024-06-11T16:03:33.464350+0000","last_deep_scrub":"90'222","last_deep_scrub_stamp":"2024-06-11T16:03:33.464350+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.464350+0000","objects_scrubbed":52,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:49:48.373086+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91625,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"90'202","reported_seq":290,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.913279+0000","last_change":"2024-06-11T16:03:42.913359+0000","last_active":"2024-06-11T16:03:42.913279+0000","last_peered":"2024-06-11T16:03:42.913279+0000","last_clean":"2024-06-11T16:03:42.913279+0000","last_became_active":"2024-06-11T16:03:14.177535+0000","last_became_peered":"2024-06-11T16:03:14.177535+0000","last_unstale":"2024-06-11T16:03:42.913279+0000","last_undegraded":"2024-06-11T16:03:42.913279+0000","last_fullsized":"2024-06-11T16:03:42.913279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'202","last_scrub_stamp":"2024-06-11T16:03:42.913182+0000","last_deep_scrub":"90'202","last_deep_scrub_stamp":"2024-06-11T16:03:42.913182+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.913182+0000","objects_scrubbed":42,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:11:29.158862+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96613,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"90'214","reported_seq":322,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:59.010369+0000","last_change":"2024-06-11T16:03:59.010402+0000","last_active":"2024-06-11T16:03:59.010369+0000","last_peered":"2024-06-11T16:03:59.010369+0000","last_clean":"2024-06-11T16:03:59.010369+0000","last_became_active":"2024-06-11T16:03:16.170621+0000","last_became_peered":"2024-06-11T16:03:16.170621+0000","last_unstale":"2024-06-11T16:03:59.010369+0000","last_undegraded":"2024-06-11T16:03:59.010369+0000","last_fullsized":"2024-06-11T16:03:59.010369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:59.010287+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:59.010287+0000","last_clean_scrub_stamp":"2024-06-11T16:03:59.010287+0000","objects_scrubbed":59,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:55:46.026715+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343596,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"90'192","reported_seq":455,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:59.816739+0000","last_change":"2024-06-11T16:03:59.816769+0000","last_active":"2024-06-11T16:03:59.816739+0000","last_peered":"2024-06-11T16:03:59.816739+0000","last_clean":"2024-06-11T16:03:59.816739+0000","last_became_active":"2024-06-11T16:03:19.138759+0000","last_became_peered":"2024-06-11T16:03:19.138759+0000","last_unstale":"2024-06-11T16:03:59.816739+0000","last_undegraded":"2024-06-11T16:03:59.816739+0000","last_fullsized":"2024-06-11T16:03:59.816739+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'192","last_scrub_stamp":"2024-06-11T16:03:59.816658+0000","last_deep_scrub":"90'192","last_deep_scrub_stamp":"2024-06-11T16:03:59.816658+0000","last_clean_scrub_stamp":"2024-06-11T16:03:59.816658+0000","objects_scrubbed":53,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:28:37.141097+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95258,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":95258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"90'185","reported_seq":298,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.884424+0000","last_change":"2024-06-11T16:03:41.884468+0000","last_active":"2024-06-11T16:03:41.884424+0000","last_peered":"2024-06-11T16:03:41.884424+0000","last_clean":"2024-06-11T16:03:41.884424+0000","last_became_active":"2024-06-11T16:03:14.180362+0000","last_became_peered":"2024-06-11T16:03:14.180362+0000","last_unstale":"2024-06-11T16:03:41.884424+0000","last_undegraded":"2024-06-11T16:03:41.884424+0000","last_fullsized":"2024-06-11T16:03:41.884424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'185","last_scrub_stamp":"2024-06-11T16:03:41.884343+0000","last_deep_scrub":"90'185","last_deep_scrub_stamp":"2024-06-11T16:03:41.884343+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.884343+0000","objects_scrubbed":51,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:03:40.164710+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185291,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"90'217","reported_seq":340,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.841608+0000","last_change":"2024-06-11T16:03:39.841650+0000","last_active":"2024-06-11T16:03:39.841608+0000","last_peered":"2024-06-11T16:03:39.841608+0000","last_clean":"2024-06-11T16:03:39.841608+0000","last_became_active":"2024-06-11T16:03:16.187145+0000","last_became_peered":"2024-06-11T16:03:16.187145+0000","last_unstale":"2024-06-11T16:03:39.841608+0000","last_undegraded":"2024-06-11T16:03:39.841608+0000","last_fullsized":"2024-06-11T16:03:39.841608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'217","last_scrub_stamp":"2024-06-11T16:03:39.841528+0000","last_deep_scrub":"90'217","last_deep_scrub_stamp":"2024-06-11T16:03:39.841528+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.841528+0000","objects_scrubbed":47,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:39:14.376531+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63802,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":63802,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"90'214","reported_seq":288,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:51.972098+0000","last_change":"2024-06-11T16:03:51.972145+0000","last_active":"2024-06-11T16:03:51.972098+0000","last_peered":"2024-06-11T16:03:51.972098+0000","last_clean":"2024-06-11T16:03:51.972098+0000","last_became_active":"2024-06-11T16:03:18.182241+0000","last_became_peered":"2024-06-11T16:03:18.182241+0000","last_unstale":"2024-06-11T16:03:51.972098+0000","last_undegraded":"2024-06-11T16:03:51.972098+0000","last_fullsized":"2024-06-11T16:03:51.972098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:51.972012+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:51.972012+0000","last_clean_scrub_stamp":"2024-06-11T16:03:51.972012+0000","objects_scrubbed":42,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:30:05.230768+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276550,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":4276510,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"90'237","reported_seq":345,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.873469+0000","last_change":"2024-06-11T16:03:40.873504+0000","last_active":"2024-06-11T16:03:40.873469+0000","last_peered":"2024-06-11T16:03:40.873469+0000","last_clean":"2024-06-11T16:03:40.873469+0000","last_became_active":"2024-06-11T16:03:16.178434+0000","last_became_peered":"2024-06-11T16:03:16.178434+0000","last_unstale":"2024-06-11T16:03:40.873469+0000","last_undegraded":"2024-06-11T16:03:40.873469+0000","last_fullsized":"2024-06-11T16:03:40.873469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'237","last_scrub_stamp":"2024-06-11T16:03:40.873374+0000","last_deep_scrub":"90'237","last_deep_scrub_stamp":"2024-06-11T16:03:40.873374+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.873374+0000","objects_scrubbed":59,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:04:30.025773+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4281595,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"90'210","reported_seq":376,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.445172+0000","last_change":"2024-06-11T16:03:34.445172+0000","last_active":"2024-06-11T16:03:34.445172+0000","last_peered":"2024-06-11T16:03:34.445172+0000","last_clean":"2024-06-11T16:03:34.445172+0000","last_became_active":"2024-06-11T15:58:59.199105+0000","last_became_peered":"2024-06-11T15:58:59.199105+0000","last_unstale":"2024-06-11T16:03:34.445172+0000","last_undegraded":"2024-06-11T16:03:34.445172+0000","last_fullsized":"2024-06-11T16:03:34.445172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'210","last_scrub_stamp":"2024-06-11T16:03:34.445046+0000","last_deep_scrub":"90'210","last_deep_scrub_stamp":"2024-06-11T16:03:34.445046+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.445046+0000","objects_scrubbed":47,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:16:48.215032+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278026,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"90'199","reported_seq":293,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:33.762178+0000","last_change":"2024-06-11T16:03:33.762208+0000","last_active":"2024-06-11T16:03:33.762178+0000","last_peered":"2024-06-11T16:03:33.762178+0000","last_clean":"2024-06-11T16:03:33.762178+0000","last_became_active":"2024-06-11T16:03:14.178840+0000","last_became_peered":"2024-06-11T16:03:14.178840+0000","last_unstale":"2024-06-11T16:03:33.762178+0000","last_undegraded":"2024-06-11T16:03:33.762178+0000","last_fullsized":"2024-06-11T16:03:33.762178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'199","last_scrub_stamp":"2024-06-11T16:03:33.762088+0000","last_deep_scrub":"90'199","last_deep_scrub_stamp":"2024-06-11T16:03:33.762088+0000","last_clean_scrub_stamp":"2024-06-11T16:03:33.762088+0000","objects_scrubbed":50,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:35:38.124306+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453286,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"90'198","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.474065+0000","last_change":"2024-06-11T16:03:37.474118+0000","last_active":"2024-06-11T16:03:37.474065+0000","last_peered":"2024-06-11T16:03:37.474065+0000","last_clean":"2024-06-11T16:03:37.474065+0000","last_became_active":"2024-06-11T15:58:59.196099+0000","last_became_peered":"2024-06-11T15:58:59.196099+0000","last_unstale":"2024-06-11T16:03:37.474065+0000","last_undegraded":"2024-06-11T16:03:37.474065+0000","last_fullsized":"2024-06-11T16:03:37.474065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'198","last_scrub_stamp":"2024-06-11T16:03:37.473970+0000","last_deep_scrub":"90'198","last_deep_scrub_stamp":"2024-06-11T16:03:37.473970+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.473970+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:49:33.128895+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167087,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"90'235","reported_seq":343,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:57.970715+0000","last_change":"2024-06-11T16:03:57.970761+0000","last_active":"2024-06-11T16:03:57.970715+0000","last_peered":"2024-06-11T16:03:57.970715+0000","last_clean":"2024-06-11T16:03:57.970715+0000","last_became_active":"2024-06-11T16:03:16.172236+0000","last_became_peered":"2024-06-11T16:03:16.172236+0000","last_unstale":"2024-06-11T16:03:57.970715+0000","last_undegraded":"2024-06-11T16:03:57.970715+0000","last_fullsized":"2024-06-11T16:03:57.970715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'235","last_scrub_stamp":"2024-06-11T16:03:57.970602+0000","last_deep_scrub":"90'235","last_deep_scrub_stamp":"2024-06-11T16:03:57.970602+0000","last_clean_scrub_stamp":"2024-06-11T16:03:57.970602+0000","objects_scrubbed":50,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:47:42.875463+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118304,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"90'214","reported_seq":342,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.794414+0000","last_change":"2024-06-11T16:03:36.794446+0000","last_active":"2024-06-11T16:03:36.794414+0000","last_peered":"2024-06-11T16:03:36.794414+0000","last_clean":"2024-06-11T16:03:36.794414+0000","last_became_active":"2024-06-11T16:03:19.138247+0000","last_became_peered":"2024-06-11T16:03:19.138247+0000","last_unstale":"2024-06-11T16:03:36.794414+0000","last_undegraded":"2024-06-11T16:03:36.794414+0000","last_fullsized":"2024-06-11T16:03:36.794414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:36.794309+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:36.794309+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.794309+0000","objects_scrubbed":55,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:24:35.567513+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122590,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":122590,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"90'229","reported_seq":520,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:00.841909+0000","last_change":"2024-06-11T16:04:00.841951+0000","last_active":"2024-06-11T16:04:00.841909+0000","last_peered":"2024-06-11T16:04:00.841909+0000","last_clean":"2024-06-11T16:04:00.841909+0000","last_became_active":"2024-06-11T16:03:20.141624+0000","last_became_peered":"2024-06-11T16:03:20.141624+0000","last_unstale":"2024-06-11T16:04:00.841909+0000","last_undegraded":"2024-06-11T16:04:00.841909+0000","last_fullsized":"2024-06-11T16:04:00.841909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'229","last_scrub_stamp":"2024-06-11T16:04:00.841811+0000","last_deep_scrub":"90'229","last_deep_scrub_stamp":"2024-06-11T16:04:00.841811+0000","last_clean_scrub_stamp":"2024-06-11T16:04:00.841811+0000","objects_scrubbed":61,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:50:15.750548+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":251328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"90'212","reported_seq":598,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:59.404758+0000","last_change":"2024-06-11T16:03:59.404819+0000","last_active":"2024-06-11T16:03:59.404758+0000","last_peered":"2024-06-11T16:03:59.404758+0000","last_clean":"2024-06-11T16:03:59.404758+0000","last_became_active":"2024-06-11T16:03:19.139100+0000","last_became_peered":"2024-06-11T16:03:19.139100+0000","last_unstale":"2024-06-11T16:03:59.404758+0000","last_undegraded":"2024-06-11T16:03:59.404758+0000","last_fullsized":"2024-06-11T16:03:59.404758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'212","last_scrub_stamp":"2024-06-11T16:03:59.404675+0000","last_deep_scrub":"90'212","last_deep_scrub_stamp":"2024-06-11T16:03:59.404675+0000","last_clean_scrub_stamp":"2024-06-11T16:03:59.404675+0000","objects_scrubbed":49,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:08:02.327734+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136026,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":127417,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"90'219","reported_seq":335,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.903414+0000","last_change":"2024-06-11T16:03:44.903442+0000","last_active":"2024-06-11T16:03:44.903414+0000","last_peered":"2024-06-11T16:03:44.903414+0000","last_clean":"2024-06-11T16:03:44.903414+0000","last_became_active":"2024-06-11T16:03:14.177633+0000","last_became_peered":"2024-06-11T16:03:14.177633+0000","last_unstale":"2024-06-11T16:03:44.903414+0000","last_undegraded":"2024-06-11T16:03:44.903414+0000","last_fullsized":"2024-06-11T16:03:44.903414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'219","last_scrub_stamp":"2024-06-11T16:03:44.903335+0000","last_deep_scrub":"90'219","last_deep_scrub_stamp":"2024-06-11T16:03:44.903335+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.903335+0000","objects_scrubbed":52,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:38:41.010767+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105170,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"90'215","reported_seq":505,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:58.811877+0000","last_change":"2024-06-11T16:03:58.811919+0000","last_active":"2024-06-11T16:03:58.811877+0000","last_peered":"2024-06-11T16:03:58.811877+0000","last_clean":"2024-06-11T16:03:58.811877+0000","last_became_active":"2024-06-11T16:03:18.182830+0000","last_became_peered":"2024-06-11T16:03:18.182830+0000","last_unstale":"2024-06-11T16:03:58.811877+0000","last_undegraded":"2024-06-11T16:03:58.811877+0000","last_fullsized":"2024-06-11T16:03:58.811877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'215","last_scrub_stamp":"2024-06-11T16:03:58.811778+0000","last_deep_scrub":"90'215","last_deep_scrub_stamp":"2024-06-11T16:03:58.811778+0000","last_clean_scrub_stamp":"2024-06-11T16:03:58.811778+0000","objects_scrubbed":64,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:47:24.132770+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587914,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":587865,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"90'254","reported_seq":673,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:01.436100+0000","last_change":"2024-06-11T16:04:01.436132+0000","last_active":"2024-06-11T16:04:01.436100+0000","last_peered":"2024-06-11T16:04:01.436100+0000","last_clean":"2024-06-11T16:04:01.436100+0000","last_became_active":"2024-06-11T16:03:21.150539+0000","last_became_peered":"2024-06-11T16:03:21.150539+0000","last_unstale":"2024-06-11T16:04:01.436100+0000","last_undegraded":"2024-06-11T16:04:01.436100+0000","last_fullsized":"2024-06-11T16:04:01.436100+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'254","last_scrub_stamp":"2024-06-11T16:04:01.436020+0000","last_deep_scrub":"90'254","last_deep_scrub_stamp":"2024-06-11T16:04:01.436020+0000","last_clean_scrub_stamp":"2024-06-11T16:04:01.436020+0000","objects_scrubbed":56,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:41:18.290600+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252256,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":246886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"90'203","reported_seq":270,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:07.044942+0000","last_change":"2024-06-11T16:04:07.045005+0000","last_active":"2024-06-11T16:04:07.044942+0000","last_peered":"2024-06-11T16:04:07.044942+0000","last_clean":"2024-06-11T16:04:07.044942+0000","last_became_active":"2024-06-11T16:03:23.149303+0000","last_became_peered":"2024-06-11T16:03:23.149303+0000","last_unstale":"2024-06-11T16:04:07.044942+0000","last_undegraded":"2024-06-11T16:04:07.044942+0000","last_fullsized":"2024-06-11T16:04:07.044942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'203","last_scrub_stamp":"2024-06-11T16:04:07.044817+0000","last_deep_scrub":"90'203","last_deep_scrub_stamp":"2024-06-11T16:04:07.044817+0000","last_clean_scrub_stamp":"2024-06-11T16:04:07.044817+0000","objects_scrubbed":45,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:58:33.376532+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":84439,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"90'193","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:51.838522+0000","last_change":"2024-06-11T16:03:51.838581+0000","last_active":"2024-06-11T16:03:51.838522+0000","last_peered":"2024-06-11T16:03:51.838522+0000","last_clean":"2024-06-11T16:03:51.838522+0000","last_became_active":"2024-06-11T16:03:04.093488+0000","last_became_peered":"2024-06-11T16:03:04.093488+0000","last_unstale":"2024-06-11T16:03:51.838522+0000","last_undegraded":"2024-06-11T16:03:51.838522+0000","last_fullsized":"2024-06-11T16:03:51.838522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'193","last_scrub_stamp":"2024-06-11T16:03:51.838440+0000","last_deep_scrub":"90'193","last_deep_scrub_stamp":"2024-06-11T16:03:51.838440+0000","last_clean_scrub_stamp":"2024-06-11T16:03:51.838440+0000","objects_scrubbed":44,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:28:24.502851+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198856,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":198856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"90'226","reported_seq":393,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.407432+0000","last_change":"2024-06-11T16:03:43.407469+0000","last_active":"2024-06-11T16:03:43.407432+0000","last_peered":"2024-06-11T16:03:43.407432+0000","last_clean":"2024-06-11T16:03:43.407432+0000","last_became_active":"2024-06-11T15:58:59.195167+0000","last_became_peered":"2024-06-11T15:58:59.195167+0000","last_unstale":"2024-06-11T16:03:43.407432+0000","last_undegraded":"2024-06-11T16:03:43.407432+0000","last_fullsized":"2024-06-11T16:03:43.407432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'226","last_scrub_stamp":"2024-06-11T16:03:43.407354+0000","last_deep_scrub":"90'226","last_deep_scrub_stamp":"2024-06-11T16:03:43.407354+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.407354+0000","objects_scrubbed":60,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:11:00.753181+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178415,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"90'253","reported_seq":574,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:03.875049+0000","last_change":"2024-06-11T16:04:03.875097+0000","last_active":"2024-06-11T16:04:03.875049+0000","last_peered":"2024-06-11T16:04:03.875049+0000","last_clean":"2024-06-11T16:04:03.875049+0000","last_became_active":"2024-06-11T16:03:22.143453+0000","last_became_peered":"2024-06-11T16:03:22.143453+0000","last_unstale":"2024-06-11T16:04:03.875049+0000","last_undegraded":"2024-06-11T16:04:03.875049+0000","last_fullsized":"2024-06-11T16:04:03.875049+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'253","last_scrub_stamp":"2024-06-11T16:04:03.874947+0000","last_deep_scrub":"90'253","last_deep_scrub_stamp":"2024-06-11T16:04:03.874947+0000","last_clean_scrub_stamp":"2024-06-11T16:04:03.874947+0000","objects_scrubbed":67,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:47:23.392155+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87492,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":87492,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"90'259","reported_seq":426,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.481119+0000","last_change":"2024-06-11T16:03:35.481159+0000","last_active":"2024-06-11T16:03:35.481119+0000","last_peered":"2024-06-11T16:03:35.481119+0000","last_clean":"2024-06-11T16:03:35.481119+0000","last_became_active":"2024-06-11T15:58:59.196392+0000","last_became_peered":"2024-06-11T15:58:59.196392+0000","last_unstale":"2024-06-11T16:03:35.481119+0000","last_undegraded":"2024-06-11T16:03:35.481119+0000","last_fullsized":"2024-06-11T16:03:35.481119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'259","last_scrub_stamp":"2024-06-11T16:03:35.481040+0000","last_deep_scrub":"90'259","last_deep_scrub_stamp":"2024-06-11T16:03:35.481040+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.481040+0000","objects_scrubbed":66,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:20:12.647916+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164188,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"90'247","reported_seq":378,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:50.022429+0000","last_change":"2024-06-11T16:03:50.022466+0000","last_active":"2024-06-11T16:03:50.022429+0000","last_peered":"2024-06-11T16:03:50.022429+0000","last_clean":"2024-06-11T16:03:50.022429+0000","last_became_active":"2024-06-11T16:03:18.181129+0000","last_became_peered":"2024-06-11T16:03:18.181129+0000","last_unstale":"2024-06-11T16:03:50.022429+0000","last_undegraded":"2024-06-11T16:03:50.022429+0000","last_fullsized":"2024-06-11T16:03:50.022429+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'247","last_scrub_stamp":"2024-06-11T16:03:50.022331+0000","last_deep_scrub":"90'247","last_deep_scrub_stamp":"2024-06-11T16:03:50.022331+0000","last_clean_scrub_stamp":"2024-06-11T16:03:50.022331+0000","objects_scrubbed":56,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:27:06.025088+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590029,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":590029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"90'200","reported_seq":310,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.814600+0000","last_change":"2024-06-11T16:03:37.814655+0000","last_active":"2024-06-11T16:03:37.814600+0000","last_peered":"2024-06-11T16:03:37.814600+0000","last_clean":"2024-06-11T16:03:37.814600+0000","last_became_active":"2024-06-11T16:03:14.178305+0000","last_became_peered":"2024-06-11T16:03:14.178305+0000","last_unstale":"2024-06-11T16:03:37.814600+0000","last_undegraded":"2024-06-11T16:03:37.814600+0000","last_fullsized":"2024-06-11T16:03:37.814600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'200","last_scrub_stamp":"2024-06-11T16:03:37.814513+0000","last_deep_scrub":"90'200","last_deep_scrub_stamp":"2024-06-11T16:03:37.814513+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.814513+0000","objects_scrubbed":45,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:03:50.089718+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250499,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"90'125","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.914448+0000","last_change":"2024-06-11T16:03:46.914477+0000","last_active":"2024-06-11T16:03:46.914448+0000","last_peered":"2024-06-11T16:03:46.914448+0000","last_clean":"2024-06-11T16:03:46.914448+0000","last_became_active":"2024-06-11T16:03:16.179903+0000","last_became_peered":"2024-06-11T16:03:16.179903+0000","last_unstale":"2024-06-11T16:03:46.914448+0000","last_undegraded":"2024-06-11T16:03:46.914448+0000","last_fullsized":"2024-06-11T16:03:46.914448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'125","last_scrub_stamp":"2024-06-11T16:03:46.914364+0000","last_deep_scrub":"90'125","last_deep_scrub_stamp":"2024-06-11T16:03:46.914364+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.914364+0000","objects_scrubbed":3,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:09:29.727340+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"90'190","reported_seq":306,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.888820+0000","last_change":"2024-06-11T16:03:46.888869+0000","last_active":"2024-06-11T16:03:46.888820+0000","last_peered":"2024-06-11T16:03:46.888820+0000","last_clean":"2024-06-11T16:03:46.888820+0000","last_became_active":"2024-06-11T16:03:14.177430+0000","last_became_peered":"2024-06-11T16:03:14.177430+0000","last_unstale":"2024-06-11T16:03:46.888820+0000","last_undegraded":"2024-06-11T16:03:46.888820+0000","last_fullsized":"2024-06-11T16:03:46.888820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'190","last_scrub_stamp":"2024-06-11T16:03:46.888740+0000","last_deep_scrub":"90'190","last_deep_scrub_stamp":"2024-06-11T16:03:46.888740+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.888740+0000","objects_scrubbed":47,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:46:46.616571+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67662,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.385661+0000","last_change":"2024-06-11T16:03:36.385661+0000","last_active":"2024-06-11T16:03:36.385661+0000","last_peered":"2024-06-11T16:03:36.385661+0000","last_clean":"2024-06-11T16:03:36.385661+0000","last_became_active":"2024-06-11T16:03:01.081684+0000","last_became_peered":"2024-06-11T16:03:01.081684+0000","last_unstale":"2024-06-11T16:03:36.385661+0000","last_undegraded":"2024-06-11T16:03:36.385661+0000","last_fullsized":"2024-06-11T16:03:36.385661+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:36.385493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:36.385493+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.385493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:46:55.902701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"90'236","reported_seq":638,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.474718+0000","last_change":"2024-06-11T16:03:38.474718+0000","last_active":"2024-06-11T16:03:38.474718+0000","last_peered":"2024-06-11T16:03:38.474718+0000","last_clean":"2024-06-11T16:03:38.474718+0000","last_became_active":"2024-06-11T16:03:04.095380+0000","last_became_peered":"2024-06-11T16:03:04.095380+0000","last_unstale":"2024-06-11T16:03:38.474718+0000","last_undegraded":"2024-06-11T16:03:38.474718+0000","last_fullsized":"2024-06-11T16:03:38.474718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'236","last_scrub_stamp":"2024-06-11T16:03:38.474609+0000","last_deep_scrub":"90'236","last_deep_scrub_stamp":"2024-06-11T16:03:38.474609+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.474609+0000","objects_scrubbed":56,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:29:45.895183+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633523,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":628082,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.856522+0000","last_change":"2024-06-11T16:03:43.856550+0000","last_active":"2024-06-11T16:03:43.856522+0000","last_peered":"2024-06-11T16:03:43.856522+0000","last_clean":"2024-06-11T16:03:43.856522+0000","last_became_active":"2024-06-11T16:03:15.170824+0000","last_became_peered":"2024-06-11T16:03:15.170824+0000","last_unstale":"2024-06-11T16:03:43.856522+0000","last_undegraded":"2024-06-11T16:03:43.856522+0000","last_fullsized":"2024-06-11T16:03:43.856522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:43.856424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:43.856424+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.856424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:02:20.638989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"90'262","reported_seq":639,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.437298+0000","last_change":"2024-06-11T16:03:40.437298+0000","last_active":"2024-06-11T16:03:40.437298+0000","last_peered":"2024-06-11T16:03:40.437298+0000","last_clean":"2024-06-11T16:03:40.437298+0000","last_became_active":"2024-06-11T16:03:05.093675+0000","last_became_peered":"2024-06-11T16:03:05.093675+0000","last_unstale":"2024-06-11T16:03:40.437298+0000","last_undegraded":"2024-06-11T16:03:40.437298+0000","last_fullsized":"2024-06-11T16:03:40.437298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'262","last_scrub_stamp":"2024-06-11T16:03:40.437138+0000","last_deep_scrub":"90'262","last_deep_scrub_stamp":"2024-06-11T16:03:40.437138+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.437138+0000","objects_scrubbed":49,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:11:49.937628+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75789,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":75789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"90'13","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.867460+0000","last_change":"2024-06-11T16:03:41.867495+0000","last_active":"2024-06-11T16:03:41.867460+0000","last_peered":"2024-06-11T16:03:41.867460+0000","last_clean":"2024-06-11T16:03:41.867460+0000","last_became_active":"2024-06-11T16:03:16.185496+0000","last_became_peered":"2024-06-11T16:03:16.185496+0000","last_unstale":"2024-06-11T16:03:41.867460+0000","last_undegraded":"2024-06-11T16:03:41.867460+0000","last_fullsized":"2024-06-11T16:03:41.867460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'13","last_scrub_stamp":"2024-06-11T16:03:41.867375+0000","last_deep_scrub":"90'13","last_deep_scrub_stamp":"2024-06-11T16:03:41.867375+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.867375+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:46.477478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"90'2","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:53.976751+0000","last_change":"2024-06-11T16:03:53.976779+0000","last_active":"2024-06-11T16:03:53.976751+0000","last_peered":"2024-06-11T16:03:53.976751+0000","last_clean":"2024-06-11T16:03:53.976751+0000","last_became_active":"2024-06-11T16:03:01.080614+0000","last_became_peered":"2024-06-11T16:03:01.080614+0000","last_unstale":"2024-06-11T16:03:53.976751+0000","last_undegraded":"2024-06-11T16:03:53.976751+0000","last_fullsized":"2024-06-11T16:03:53.976751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'2","last_scrub_stamp":"2024-06-11T16:03:53.976672+0000","last_deep_scrub":"90'2","last_deep_scrub_stamp":"2024-06-11T16:03:53.976672+0000","last_clean_scrub_stamp":"2024-06-11T16:03:53.976672+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:42:52.266387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"90'212","reported_seq":564,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:52.869041+0000","last_change":"2024-06-11T16:03:52.869078+0000","last_active":"2024-06-11T16:03:52.869041+0000","last_peered":"2024-06-11T16:03:52.869041+0000","last_clean":"2024-06-11T16:03:52.869041+0000","last_became_active":"2024-06-11T16:03:04.093754+0000","last_became_peered":"2024-06-11T16:03:04.093754+0000","last_unstale":"2024-06-11T16:03:52.869041+0000","last_undegraded":"2024-06-11T16:03:52.869041+0000","last_fullsized":"2024-06-11T16:03:52.869041+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'212","last_scrub_stamp":"2024-06-11T16:03:52.868952+0000","last_deep_scrub":"90'212","last_deep_scrub_stamp":"2024-06-11T16:03:52.868952+0000","last_clean_scrub_stamp":"2024-06-11T16:03:52.868952+0000","objects_scrubbed":57,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:49:00.469757+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222792,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":222792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:57.775913+0000","last_change":"2024-06-11T16:03:57.775983+0000","last_active":"2024-06-11T16:03:57.775913+0000","last_peered":"2024-06-11T16:03:57.775913+0000","last_clean":"2024-06-11T16:03:57.775913+0000","last_became_active":"2024-06-11T16:03:15.178530+0000","last_became_peered":"2024-06-11T16:03:15.178530+0000","last_unstale":"2024-06-11T16:03:57.775913+0000","last_undegraded":"2024-06-11T16:03:57.775913+0000","last_fullsized":"2024-06-11T16:03:57.775913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'5","last_scrub_stamp":"2024-06-11T16:03:57.775807+0000","last_deep_scrub":"90'5","last_deep_scrub_stamp":"2024-06-11T16:03:57.775807+0000","last_clean_scrub_stamp":"2024-06-11T16:03:57.775807+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:33:10.680924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"90'226","reported_seq":349,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.854419+0000","last_change":"2024-06-11T16:03:38.854480+0000","last_active":"2024-06-11T16:03:38.854419+0000","last_peered":"2024-06-11T16:03:38.854419+0000","last_clean":"2024-06-11T16:03:38.854419+0000","last_became_active":"2024-06-11T16:03:14.178121+0000","last_became_peered":"2024-06-11T16:03:14.178121+0000","last_unstale":"2024-06-11T16:03:38.854419+0000","last_undegraded":"2024-06-11T16:03:38.854419+0000","last_fullsized":"2024-06-11T16:03:38.854419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'226","last_scrub_stamp":"2024-06-11T16:03:38.854322+0000","last_deep_scrub":"90'226","last_deep_scrub_stamp":"2024-06-11T16:03:38.854322+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.854322+0000","objects_scrubbed":59,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:12:42.139827+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192383,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"90'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:43.888389+0000","last_change":"2024-06-11T16:03:43.888423+0000","last_active":"2024-06-11T16:03:43.888389+0000","last_peered":"2024-06-11T16:03:43.888389+0000","last_clean":"2024-06-11T16:03:43.888389+0000","last_became_active":"2024-06-11T16:03:16.190837+0000","last_became_peered":"2024-06-11T16:03:16.190837+0000","last_unstale":"2024-06-11T16:03:43.888389+0000","last_undegraded":"2024-06-11T16:03:43.888389+0000","last_fullsized":"2024-06-11T16:03:43.888389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-06-11T16:03:43.888252+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-06-11T16:03:43.888252+0000","last_clean_scrub_stamp":"2024-06-11T16:03:43.888252+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:28:11.005974+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":140,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"90'211","reported_seq":331,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:06.055396+0000","last_change":"2024-06-11T16:04:06.055459+0000","last_active":"2024-06-11T16:04:06.055396+0000","last_peered":"2024-06-11T16:04:06.055396+0000","last_clean":"2024-06-11T16:04:06.055396+0000","last_became_active":"2024-06-11T16:03:23.149382+0000","last_became_peered":"2024-06-11T16:03:23.149382+0000","last_unstale":"2024-06-11T16:04:06.055396+0000","last_undegraded":"2024-06-11T16:04:06.055396+0000","last_fullsized":"2024-06-11T16:04:06.055396+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'211","last_scrub_stamp":"2024-06-11T16:04:06.055302+0000","last_deep_scrub":"90'211","last_deep_scrub_stamp":"2024-06-11T16:04:06.055302+0000","last_clean_scrub_stamp":"2024-06-11T16:04:06.055302+0000","objects_scrubbed":47,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:45:04.543202+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91951,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":82765,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:56.953294+0000","last_change":"2024-06-11T16:03:56.953319+0000","last_active":"2024-06-11T16:03:56.953294+0000","last_peered":"2024-06-11T16:03:56.953294+0000","last_clean":"2024-06-11T16:03:56.953294+0000","last_became_active":"2024-06-11T16:03:16.170781+0000","last_became_peered":"2024-06-11T16:03:16.170781+0000","last_unstale":"2024-06-11T16:03:56.953294+0000","last_undegraded":"2024-06-11T16:03:56.953294+0000","last_fullsized":"2024-06-11T16:03:56.953294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:56.953173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:56.953173+0000","last_clean_scrub_stamp":"2024-06-11T16:03:56.953173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:04:14.664954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"90'216","reported_seq":605,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:03.443839+0000","last_change":"2024-06-11T16:04:03.443868+0000","last_active":"2024-06-11T16:04:03.443839+0000","last_peered":"2024-06-11T16:04:03.443839+0000","last_clean":"2024-06-11T16:04:03.443839+0000","last_became_active":"2024-06-11T16:03:22.143323+0000","last_became_peered":"2024-06-11T16:03:22.143323+0000","last_unstale":"2024-06-11T16:04:03.443839+0000","last_undegraded":"2024-06-11T16:04:03.443839+0000","last_fullsized":"2024-06-11T16:04:03.443839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'216","last_scrub_stamp":"2024-06-11T16:04:03.443759+0000","last_deep_scrub":"90'216","last_deep_scrub_stamp":"2024-06-11T16:04:03.443759+0000","last_clean_scrub_stamp":"2024-06-11T16:04:03.443759+0000","objects_scrubbed":51,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:20:23.513934+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252800,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":245064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"90'14","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:57.331521+0000","last_change":"2024-06-11T16:03:57.331565+0000","last_active":"2024-06-11T16:03:57.331521+0000","last_peered":"2024-06-11T16:03:57.331521+0000","last_clean":"2024-06-11T16:03:57.331521+0000","last_became_active":"2024-06-11T16:03:15.197256+0000","last_became_peered":"2024-06-11T16:03:15.197256+0000","last_unstale":"2024-06-11T16:03:57.331521+0000","last_undegraded":"2024-06-11T16:03:57.331521+0000","last_fullsized":"2024-06-11T16:03:57.331521+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'14","last_scrub_stamp":"2024-06-11T16:03:57.331380+0000","last_deep_scrub":"90'14","last_deep_scrub_stamp":"2024-06-11T16:03:57.331380+0000","last_clean_scrub_stamp":"2024-06-11T16:03:57.331380+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:15:05.007031+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"90'238","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.782639+0000","last_change":"2024-06-11T16:03:35.782683+0000","last_active":"2024-06-11T16:03:35.782639+0000","last_peered":"2024-06-11T16:03:35.782639+0000","last_clean":"2024-06-11T16:03:35.782639+0000","last_became_active":"2024-06-11T16:03:20.142944+0000","last_became_peered":"2024-06-11T16:03:20.142944+0000","last_unstale":"2024-06-11T16:03:35.782639+0000","last_undegraded":"2024-06-11T16:03:35.782639+0000","last_fullsized":"2024-06-11T16:03:35.782639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'238","last_scrub_stamp":"2024-06-11T16:03:35.782561+0000","last_deep_scrub":"90'238","last_deep_scrub_stamp":"2024-06-11T16:03:35.782561+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.782561+0000","objects_scrubbed":63,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:34:35.500910+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133235,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":133235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:01.013880+0000","last_change":"2024-06-11T16:04:01.013907+0000","last_active":"2024-06-11T16:04:01.013880+0000","last_peered":"2024-06-11T16:04:01.013880+0000","last_clean":"2024-06-11T16:04:01.013880+0000","last_became_active":"2024-06-11T16:03:16.173690+0000","last_became_peered":"2024-06-11T16:03:16.173690+0000","last_unstale":"2024-06-11T16:04:01.013880+0000","last_undegraded":"2024-06-11T16:04:01.013880+0000","last_fullsized":"2024-06-11T16:04:01.013880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:04:01.013768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:04:01.013768+0000","last_clean_scrub_stamp":"2024-06-11T16:04:01.013768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:49:37.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"90'222","reported_seq":297,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:03.085558+0000","last_change":"2024-06-11T16:04:03.085612+0000","last_active":"2024-06-11T16:04:03.085558+0000","last_peered":"2024-06-11T16:04:03.085558+0000","last_clean":"2024-06-11T16:04:03.085558+0000","last_became_active":"2024-06-11T16:03:20.149679+0000","last_became_peered":"2024-06-11T16:03:20.149679+0000","last_unstale":"2024-06-11T16:04:03.085558+0000","last_undegraded":"2024-06-11T16:04:03.085558+0000","last_fullsized":"2024-06-11T16:04:03.085558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'222","last_scrub_stamp":"2024-06-11T16:04:03.085465+0000","last_deep_scrub":"90'222","last_deep_scrub_stamp":"2024-06-11T16:04:03.085465+0000","last_clean_scrub_stamp":"2024-06-11T16:04:03.085465+0000","objects_scrubbed":58,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:08:44.093104+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329491,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":320451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:49.803818+0000","last_change":"2024-06-11T16:03:49.803860+0000","last_active":"2024-06-11T16:03:49.803818+0000","last_peered":"2024-06-11T16:03:49.803818+0000","last_clean":"2024-06-11T16:03:49.803818+0000","last_became_active":"2024-06-11T16:03:01.078080+0000","last_became_peered":"2024-06-11T16:03:01.078080+0000","last_unstale":"2024-06-11T16:03:49.803818+0000","last_undegraded":"2024-06-11T16:03:49.803818+0000","last_fullsized":"2024-06-11T16:03:49.803818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:49.803715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:49.803715+0000","last_clean_scrub_stamp":"2024-06-11T16:03:49.803715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:08:49.791466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"90'192","reported_seq":305,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:02.038924+0000","last_change":"2024-06-11T16:04:02.038955+0000","last_active":"2024-06-11T16:04:02.038924+0000","last_peered":"2024-06-11T16:04:02.038924+0000","last_clean":"2024-06-11T16:04:02.038924+0000","last_became_active":"2024-06-11T16:03:19.137781+0000","last_became_peered":"2024-06-11T16:03:19.137781+0000","last_unstale":"2024-06-11T16:04:02.038924+0000","last_undegraded":"2024-06-11T16:04:02.038924+0000","last_fullsized":"2024-06-11T16:04:02.038924+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'192","last_scrub_stamp":"2024-06-11T16:04:02.038838+0000","last_deep_scrub":"90'192","last_deep_scrub_stamp":"2024-06-11T16:04:02.038838+0000","last_clean_scrub_stamp":"2024-06-11T16:04:02.038838+0000","objects_scrubbed":54,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:19:37.598176+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86706,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":86706,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'1","reported_seq":76,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:48.848079+0000","last_change":"2024-06-11T16:03:48.848108+0000","last_active":"2024-06-11T16:03:48.848079+0000","last_peered":"2024-06-11T16:03:48.848079+0000","last_clean":"2024-06-11T16:03:48.848079+0000","last_became_active":"2024-06-11T16:03:14.177479+0000","last_became_peered":"2024-06-11T16:03:14.177479+0000","last_unstale":"2024-06-11T16:03:48.848079+0000","last_undegraded":"2024-06-11T16:03:48.848079+0000","last_fullsized":"2024-06-11T16:03:48.848079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-06-11T16:03:48.847977+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-06-11T16:03:48.847977+0000","last_clean_scrub_stamp":"2024-06-11T16:03:48.847977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:55:53.468697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"90'191","reported_seq":357,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.466914+0000","last_change":"2024-06-11T16:03:32.466914+0000","last_active":"2024-06-11T16:03:32.466914+0000","last_peered":"2024-06-11T16:03:32.466914+0000","last_clean":"2024-06-11T16:03:32.466914+0000","last_became_active":"2024-06-11T15:58:59.197649+0000","last_became_peered":"2024-06-11T15:58:59.197649+0000","last_unstale":"2024-06-11T16:03:32.466914+0000","last_undegraded":"2024-06-11T16:03:32.466914+0000","last_fullsized":"2024-06-11T16:03:32.466914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'191","last_scrub_stamp":"2024-06-11T16:03:32.466765+0000","last_deep_scrub":"90'191","last_deep_scrub_stamp":"2024-06-11T16:03:32.466765+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.466765+0000","objects_scrubbed":49,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:28:09.791204+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96020,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"90'159","reported_seq":266,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:34.735018+0000","last_change":"2024-06-11T16:03:34.735063+0000","last_active":"2024-06-11T16:03:34.735018+0000","last_peered":"2024-06-11T16:03:34.735018+0000","last_clean":"2024-06-11T16:03:34.735018+0000","last_became_active":"2024-06-11T16:03:19.139006+0000","last_became_peered":"2024-06-11T16:03:19.139006+0000","last_unstale":"2024-06-11T16:03:34.735018+0000","last_undegraded":"2024-06-11T16:03:34.735018+0000","last_fullsized":"2024-06-11T16:03:34.735018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'159","last_scrub_stamp":"2024-06-11T16:03:34.734931+0000","last_deep_scrub":"90'159","last_deep_scrub_stamp":"2024-06-11T16:03:34.734931+0000","last_clean_scrub_stamp":"2024-06-11T16:03:34.734931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:48:10.330843+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:52.944772+0000","last_change":"2024-06-11T16:03:52.944793+0000","last_active":"2024-06-11T16:03:52.944772+0000","last_peered":"2024-06-11T16:03:52.944772+0000","last_clean":"2024-06-11T16:03:52.944772+0000","last_became_active":"2024-06-11T16:03:16.177617+0000","last_became_peered":"2024-06-11T16:03:16.177617+0000","last_unstale":"2024-06-11T16:03:52.944772+0000","last_undegraded":"2024-06-11T16:03:52.944772+0000","last_fullsized":"2024-06-11T16:03:52.944772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:52.944687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:52.944687+0000","last_clean_scrub_stamp":"2024-06-11T16:03:52.944687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:09:16.465086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"90'25","reported_seq":192,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:54.316943+0000","last_change":"2024-06-11T16:03:54.316987+0000","last_active":"2024-06-11T16:03:54.316943+0000","last_peered":"2024-06-11T16:03:54.316943+0000","last_clean":"2024-06-11T16:03:54.316943+0000","last_became_active":"2024-06-11T15:58:58.177316+0000","last_became_peered":"2024-06-11T15:58:58.177316+0000","last_unstale":"2024-06-11T16:03:54.316943+0000","last_undegraded":"2024-06-11T16:03:54.316943+0000","last_fullsized":"2024-06-11T16:03:54.316943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'25","last_scrub_stamp":"2024-06-11T16:03:54.316853+0000","last_deep_scrub":"90'25","last_deep_scrub_stamp":"2024-06-11T16:03:54.316853+0000","last_clean_scrub_stamp":"2024-06-11T16:03:54.316853+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:06:21.246355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163108,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"90'207","reported_seq":287,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.799742+0000","last_change":"2024-06-11T16:03:32.799773+0000","last_active":"2024-06-11T16:03:32.799742+0000","last_peered":"2024-06-11T16:03:32.799742+0000","last_clean":"2024-06-11T16:03:32.799742+0000","last_became_active":"2024-06-11T16:03:19.140029+0000","last_became_peered":"2024-06-11T16:03:19.140029+0000","last_unstale":"2024-06-11T16:03:32.799742+0000","last_undegraded":"2024-06-11T16:03:32.799742+0000","last_fullsized":"2024-06-11T16:03:32.799742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'207","last_scrub_stamp":"2024-06-11T16:03:32.799651+0000","last_deep_scrub":"90'207","last_deep_scrub_stamp":"2024-06-11T16:03:32.799651+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.799651+0000","objects_scrubbed":58,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:09:13.311267+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204560,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":198844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:38.827394+0000","last_change":"2024-06-11T16:03:38.827436+0000","last_active":"2024-06-11T16:03:38.827394+0000","last_peered":"2024-06-11T16:03:38.827394+0000","last_clean":"2024-06-11T16:03:38.827394+0000","last_became_active":"2024-06-11T16:03:16.186005+0000","last_became_peered":"2024-06-11T16:03:16.186005+0000","last_unstale":"2024-06-11T16:03:38.827394+0000","last_undegraded":"2024-06-11T16:03:38.827394+0000","last_fullsized":"2024-06-11T16:03:38.827394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:38.827280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:38.827280+0000","last_clean_scrub_stamp":"2024-06-11T16:03:38.827280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:38:43.261464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"90'39","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.397394+0000","last_change":"2024-06-11T16:03:31.397437+0000","last_active":"2024-06-11T16:03:31.397394+0000","last_peered":"2024-06-11T16:03:31.397394+0000","last_clean":"2024-06-11T16:03:31.397394+0000","last_became_active":"2024-06-11T16:03:15.196557+0000","last_became_peered":"2024-06-11T16:03:15.196557+0000","last_unstale":"2024-06-11T16:03:31.397394+0000","last_undegraded":"2024-06-11T16:03:31.397394+0000","last_fullsized":"2024-06-11T16:03:31.397394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'39","last_scrub_stamp":"2024-06-11T16:03:31.397303+0000","last_deep_scrub":"90'39","last_deep_scrub_stamp":"2024-06-11T16:03:31.397303+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.397303+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:46:56.718295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329563,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":36,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":329563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"90'217","reported_seq":332,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:35.797280+0000","last_change":"2024-06-11T16:03:35.797310+0000","last_active":"2024-06-11T16:03:35.797280+0000","last_peered":"2024-06-11T16:03:35.797280+0000","last_clean":"2024-06-11T16:03:35.797280+0000","last_became_active":"2024-06-11T16:03:14.177623+0000","last_became_peered":"2024-06-11T16:03:14.177623+0000","last_unstale":"2024-06-11T16:03:35.797280+0000","last_undegraded":"2024-06-11T16:03:35.797280+0000","last_fullsized":"2024-06-11T16:03:35.797280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'217","last_scrub_stamp":"2024-06-11T16:03:35.797197+0000","last_deep_scrub":"90'217","last_deep_scrub_stamp":"2024-06-11T16:03:35.797197+0000","last_clean_scrub_stamp":"2024-06-11T16:03:35.797197+0000","objects_scrubbed":55,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:54:41.599319+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":779454,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:50.369846+0000","last_change":"2024-06-11T16:03:50.369870+0000","last_active":"2024-06-11T16:03:50.369846+0000","last_peered":"2024-06-11T16:03:50.369846+0000","last_clean":"2024-06-11T16:03:50.369846+0000","last_became_active":"2024-06-11T15:58:56.162093+0000","last_became_peered":"2024-06-11T15:58:56.162093+0000","last_unstale":"2024-06-11T16:03:50.369846+0000","last_undegraded":"2024-06-11T16:03:50.369846+0000","last_fullsized":"2024-06-11T16:03:50.369846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:50.369749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:50.369749+0000","last_clean_scrub_stamp":"2024-06-11T16:03:50.369749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:47:35.104527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"90'66","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.853554+0000","last_change":"2024-06-11T16:03:45.853585+0000","last_active":"2024-06-11T16:03:45.853554+0000","last_peered":"2024-06-11T16:03:45.853554+0000","last_clean":"2024-06-11T16:03:45.853554+0000","last_became_active":"2024-06-11T16:03:15.177511+0000","last_became_peered":"2024-06-11T16:03:15.177511+0000","last_unstale":"2024-06-11T16:03:45.853554+0000","last_undegraded":"2024-06-11T16:03:45.853554+0000","last_fullsized":"2024-06-11T16:03:45.853554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'66","last_scrub_stamp":"2024-06-11T16:03:45.853450+0000","last_deep_scrub":"90'66","last_deep_scrub_stamp":"2024-06-11T16:03:45.853450+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.853450+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:14:41.219083+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"90'224","reported_seq":391,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:39.439655+0000","last_change":"2024-06-11T16:03:39.439688+0000","last_active":"2024-06-11T16:03:39.439655+0000","last_peered":"2024-06-11T16:03:39.439655+0000","last_clean":"2024-06-11T16:03:39.439655+0000","last_became_active":"2024-06-11T15:58:59.196403+0000","last_became_peered":"2024-06-11T15:58:59.196403+0000","last_unstale":"2024-06-11T16:03:39.439655+0000","last_undegraded":"2024-06-11T16:03:39.439655+0000","last_fullsized":"2024-06-11T16:03:39.439655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'224","last_scrub_stamp":"2024-06-11T16:03:39.439556+0000","last_deep_scrub":"90'224","last_deep_scrub_stamp":"2024-06-11T16:03:39.439556+0000","last_clean_scrub_stamp":"2024-06-11T16:03:39.439556+0000","objects_scrubbed":55,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:48:17.880817+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345398,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:59.970600+0000","last_change":"2024-06-11T16:03:59.970625+0000","last_active":"2024-06-11T16:03:59.970600+0000","last_peered":"2024-06-11T16:03:59.970600+0000","last_clean":"2024-06-11T16:03:59.970600+0000","last_became_active":"2024-06-11T16:03:16.173024+0000","last_became_peered":"2024-06-11T16:03:16.173024+0000","last_unstale":"2024-06-11T16:03:59.970600+0000","last_undegraded":"2024-06-11T16:03:59.970600+0000","last_fullsized":"2024-06-11T16:03:59.970600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:59.970478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:59.970478+0000","last_clean_scrub_stamp":"2024-06-11T16:03:59.970478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:11:18.042813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:48.943327+0000","last_change":"2024-06-11T16:03:48.943352+0000","last_active":"2024-06-11T16:03:48.943327+0000","last_peered":"2024-06-11T16:03:48.943327+0000","last_clean":"2024-06-11T16:03:48.943327+0000","last_became_active":"2024-06-11T16:03:16.179233+0000","last_became_peered":"2024-06-11T16:03:16.179233+0000","last_unstale":"2024-06-11T16:03:48.943327+0000","last_undegraded":"2024-06-11T16:03:48.943327+0000","last_fullsized":"2024-06-11T16:03:48.943327+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:48.943235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:48.943235+0000","last_clean_scrub_stamp":"2024-06-11T16:03:48.943235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:10:17.774491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"90'213","reported_seq":380,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.373287+0000","last_change":"2024-06-11T16:03:47.373324+0000","last_active":"2024-06-11T16:03:47.373287+0000","last_peered":"2024-06-11T16:03:47.373287+0000","last_clean":"2024-06-11T16:03:47.373287+0000","last_became_active":"2024-06-11T15:58:59.191996+0000","last_became_peered":"2024-06-11T15:58:59.191996+0000","last_unstale":"2024-06-11T16:03:47.373287+0000","last_undegraded":"2024-06-11T16:03:47.373287+0000","last_fullsized":"2024-06-11T16:03:47.373287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'213","last_scrub_stamp":"2024-06-11T16:03:47.373190+0000","last_deep_scrub":"90'213","last_deep_scrub_stamp":"2024-06-11T16:03:47.373190+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.373190+0000","objects_scrubbed":61,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:29:20.184948+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388189,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:50.956086+0000","last_change":"2024-06-11T16:03:50.956112+0000","last_active":"2024-06-11T16:03:50.956086+0000","last_peered":"2024-06-11T16:03:50.956086+0000","last_clean":"2024-06-11T16:03:50.956086+0000","last_became_active":"2024-06-11T16:03:16.172886+0000","last_became_peered":"2024-06-11T16:03:16.172886+0000","last_unstale":"2024-06-11T16:03:50.956086+0000","last_undegraded":"2024-06-11T16:03:50.956086+0000","last_fullsized":"2024-06-11T16:03:50.956086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:50.955990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:50.955990+0000","last_clean_scrub_stamp":"2024-06-11T16:03:50.955990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:43:40.715843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:49.351092+0000","last_change":"2024-06-11T16:03:49.351116+0000","last_active":"2024-06-11T16:03:49.351092+0000","last_peered":"2024-06-11T16:03:49.351092+0000","last_clean":"2024-06-11T16:03:49.351092+0000","last_became_active":"2024-06-11T15:58:56.161999+0000","last_became_peered":"2024-06-11T15:58:56.161999+0000","last_unstale":"2024-06-11T16:03:49.351092+0000","last_undegraded":"2024-06-11T16:03:49.351092+0000","last_fullsized":"2024-06-11T16:03:49.351092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:49.351007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:49.351007+0000","last_clean_scrub_stamp":"2024-06-11T16:03:49.351007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:16:47.845695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"90'200","reported_seq":468,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:01.833177+0000","last_change":"2024-06-11T16:04:01.833226+0000","last_active":"2024-06-11T16:04:01.833177+0000","last_peered":"2024-06-11T16:04:01.833177+0000","last_clean":"2024-06-11T16:04:01.833177+0000","last_became_active":"2024-06-11T16:03:21.150581+0000","last_became_peered":"2024-06-11T16:03:21.150581+0000","last_unstale":"2024-06-11T16:04:01.833177+0000","last_undegraded":"2024-06-11T16:04:01.833177+0000","last_fullsized":"2024-06-11T16:04:01.833177+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'200","last_scrub_stamp":"2024-06-11T16:04:01.833085+0000","last_deep_scrub":"90'200","last_deep_scrub_stamp":"2024-06-11T16:04:01.833085+0000","last_clean_scrub_stamp":"2024-06-11T16:04:01.833085+0000","objects_scrubbed":40,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:17:15.603071+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375592,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":375579,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":167,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:52.393878+0000","last_change":"2024-06-11T16:03:52.393911+0000","last_active":"2024-06-11T16:03:52.393878+0000","last_peered":"2024-06-11T16:03:52.393878+0000","last_clean":"2024-06-11T16:03:52.393878+0000","last_became_active":"2024-06-11T15:58:58.177242+0000","last_became_peered":"2024-06-11T15:58:58.177242+0000","last_unstale":"2024-06-11T16:03:52.393878+0000","last_undegraded":"2024-06-11T16:03:52.393878+0000","last_fullsized":"2024-06-11T16:03:52.393878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:52.393789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:52.393789+0000","last_clean_scrub_stamp":"2024-06-11T16:03:52.393789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:05:38.011968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:56.799287+0000","last_change":"2024-06-11T16:03:56.799310+0000","last_active":"2024-06-11T16:03:56.799287+0000","last_peered":"2024-06-11T16:03:56.799287+0000","last_clean":"2024-06-11T16:03:56.799287+0000","last_became_active":"2024-06-11T16:03:14.177528+0000","last_became_peered":"2024-06-11T16:03:14.177528+0000","last_unstale":"2024-06-11T16:03:56.799287+0000","last_undegraded":"2024-06-11T16:03:56.799287+0000","last_fullsized":"2024-06-11T16:03:56.799287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:56.799199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:56.799199+0000","last_clean_scrub_stamp":"2024-06-11T16:03:56.799199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:51:52.948095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"90'233","reported_seq":541,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:02.852678+0000","last_change":"2024-06-11T16:04:02.852710+0000","last_active":"2024-06-11T16:04:02.852678+0000","last_peered":"2024-06-11T16:04:02.852678+0000","last_clean":"2024-06-11T16:04:02.852678+0000","last_became_active":"2024-06-11T16:03:21.150543+0000","last_became_peered":"2024-06-11T16:03:21.150543+0000","last_unstale":"2024-06-11T16:04:02.852678+0000","last_undegraded":"2024-06-11T16:04:02.852678+0000","last_fullsized":"2024-06-11T16:04:02.852678+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'233","last_scrub_stamp":"2024-06-11T16:04:02.852595+0000","last_deep_scrub":"90'233","last_deep_scrub_stamp":"2024-06-11T16:04:02.852595+0000","last_clean_scrub_stamp":"2024-06-11T16:04:02.852595+0000","objects_scrubbed":53,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:20:40.019471+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188854,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":179164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"90'3","reported_seq":170,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:53.354019+0000","last_change":"2024-06-11T16:03:53.354077+0000","last_active":"2024-06-11T16:03:53.354019+0000","last_peered":"2024-06-11T16:03:53.354019+0000","last_clean":"2024-06-11T16:03:53.354019+0000","last_became_active":"2024-06-11T15:58:58.176967+0000","last_became_peered":"2024-06-11T15:58:58.176967+0000","last_unstale":"2024-06-11T16:03:53.354019+0000","last_undegraded":"2024-06-11T16:03:53.354019+0000","last_fullsized":"2024-06-11T16:03:53.354019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-06-11T16:03:53.353920+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-06-11T16:03:53.353920+0000","last_clean_scrub_stamp":"2024-06-11T16:03:53.353920+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:58:51.965286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:48.332924+0000","last_change":"2024-06-11T16:03:48.332948+0000","last_active":"2024-06-11T16:03:48.332924+0000","last_peered":"2024-06-11T16:03:48.332924+0000","last_clean":"2024-06-11T16:03:48.332924+0000","last_became_active":"2024-06-11T15:58:56.162019+0000","last_became_peered":"2024-06-11T15:58:56.162019+0000","last_unstale":"2024-06-11T16:03:48.332924+0000","last_undegraded":"2024-06-11T16:03:48.332924+0000","last_fullsized":"2024-06-11T16:03:48.332924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:48.332821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:48.332821+0000","last_clean_scrub_stamp":"2024-06-11T16:03:48.332821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T00:57:45.586403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"90'205","reported_seq":582,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:02.426275+0000","last_change":"2024-06-11T16:04:02.426312+0000","last_active":"2024-06-11T16:04:02.426275+0000","last_peered":"2024-06-11T16:04:02.426275+0000","last_clean":"2024-06-11T16:04:02.426275+0000","last_became_active":"2024-06-11T16:03:22.142947+0000","last_became_peered":"2024-06-11T16:03:22.142947+0000","last_unstale":"2024-06-11T16:04:02.426275+0000","last_undegraded":"2024-06-11T16:04:02.426275+0000","last_fullsized":"2024-06-11T16:04:02.426275+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'205","last_scrub_stamp":"2024-06-11T16:04:02.426194+0000","last_deep_scrub":"90'205","last_deep_scrub_stamp":"2024-06-11T16:04:02.426194+0000","last_clean_scrub_stamp":"2024-06-11T16:04:02.426194+0000","objects_scrubbed":58,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:25:04.015551+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":143749,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"90'37","reported_seq":224,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:56.303158+0000","last_change":"2024-06-11T16:03:56.303186+0000","last_active":"2024-06-11T16:03:56.303158+0000","last_peered":"2024-06-11T16:03:56.303158+0000","last_clean":"2024-06-11T16:03:56.303158+0000","last_became_active":"2024-06-11T16:03:15.195340+0000","last_became_peered":"2024-06-11T16:03:15.195340+0000","last_unstale":"2024-06-11T16:03:56.303158+0000","last_undegraded":"2024-06-11T16:03:56.303158+0000","last_fullsized":"2024-06-11T16:03:56.303158+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'37","last_scrub_stamp":"2024-06-11T16:03:56.303073+0000","last_deep_scrub":"90'37","last_deep_scrub_stamp":"2024-06-11T16:03:56.303073+0000","last_clean_scrub_stamp":"2024-06-11T16:03:56.303073+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T17:20:31.480987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:55.979820+0000","last_change":"2024-06-11T16:03:55.979844+0000","last_active":"2024-06-11T16:03:55.979820+0000","last_peered":"2024-06-11T16:03:55.979820+0000","last_clean":"2024-06-11T16:03:55.979820+0000","last_became_active":"2024-06-11T16:03:16.166968+0000","last_became_peered":"2024-06-11T16:03:16.166968+0000","last_unstale":"2024-06-11T16:03:55.979820+0000","last_undegraded":"2024-06-11T16:03:55.979820+0000","last_fullsized":"2024-06-11T16:03:55.979820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:55.979731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:55.979731+0000","last_clean_scrub_stamp":"2024-06-11T16:03:55.979731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:07:54.817500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"90'193","reported_seq":465,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:31.768110+0000","last_change":"2024-06-11T16:03:31.768141+0000","last_active":"2024-06-11T16:03:31.768110+0000","last_peered":"2024-06-11T16:03:31.768110+0000","last_clean":"2024-06-11T16:03:31.768110+0000","last_became_active":"2024-06-11T16:03:18.180826+0000","last_became_peered":"2024-06-11T16:03:18.180826+0000","last_unstale":"2024-06-11T16:03:31.768110+0000","last_undegraded":"2024-06-11T16:03:31.768110+0000","last_fullsized":"2024-06-11T16:03:31.768110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'193","last_scrub_stamp":"2024-06-11T16:03:31.768031+0000","last_deep_scrub":"90'193","last_deep_scrub_stamp":"2024-06-11T16:03:31.768031+0000","last_clean_scrub_stamp":"2024-06-11T16:03:31.768031+0000","objects_scrubbed":56,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:08:20.180973+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184227,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":181977,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"90'224","reported_seq":284,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:05.107026+0000","last_change":"2024-06-11T16:04:05.107061+0000","last_active":"2024-06-11T16:04:05.107026+0000","last_peered":"2024-06-11T16:04:05.107026+0000","last_clean":"2024-06-11T16:04:05.107026+0000","last_became_active":"2024-06-11T16:03:21.151830+0000","last_became_peered":"2024-06-11T16:03:21.151830+0000","last_unstale":"2024-06-11T16:04:05.107026+0000","last_undegraded":"2024-06-11T16:04:05.107026+0000","last_fullsized":"2024-06-11T16:04:05.107026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'224","last_scrub_stamp":"2024-06-11T16:04:05.106953+0000","last_deep_scrub":"90'224","last_deep_scrub_stamp":"2024-06-11T16:04:05.106953+0000","last_clean_scrub_stamp":"2024-06-11T16:04:05.106953+0000","objects_scrubbed":62,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:16:37.182512+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104892,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":104866,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"90'55","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.853286+0000","last_change":"2024-06-11T16:03:44.853361+0000","last_active":"2024-06-11T16:03:44.853286+0000","last_peered":"2024-06-11T16:03:44.853286+0000","last_clean":"2024-06-11T16:03:44.853286+0000","last_became_active":"2024-06-11T16:03:16.182696+0000","last_became_peered":"2024-06-11T16:03:16.182696+0000","last_unstale":"2024-06-11T16:03:44.853286+0000","last_undegraded":"2024-06-11T16:03:44.853286+0000","last_fullsized":"2024-06-11T16:03:44.853286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'55","last_scrub_stamp":"2024-06-11T16:03:44.853199+0000","last_deep_scrub":"90'55","last_deep_scrub_stamp":"2024-06-11T16:03:44.853199+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.853199+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:12:52.557662+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4188514,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"90'198","reported_seq":365,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:45.421132+0000","last_change":"2024-06-11T16:03:45.421199+0000","last_active":"2024-06-11T16:03:45.421132+0000","last_peered":"2024-06-11T16:03:45.421132+0000","last_clean":"2024-06-11T16:03:45.421132+0000","last_became_active":"2024-06-11T15:58:59.194650+0000","last_became_peered":"2024-06-11T15:58:59.194650+0000","last_unstale":"2024-06-11T16:03:45.421132+0000","last_undegraded":"2024-06-11T16:03:45.421132+0000","last_fullsized":"2024-06-11T16:03:45.421132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'198","last_scrub_stamp":"2024-06-11T16:03:45.421035+0000","last_deep_scrub":"90'198","last_deep_scrub_stamp":"2024-06-11T16:03:45.421035+0000","last_clean_scrub_stamp":"2024-06-11T16:03:45.421035+0000","objects_scrubbed":53,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:26:24.518624+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421465,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"90'25","reported_seq":193,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:50.817988+0000","last_change":"2024-06-11T16:03:50.818025+0000","last_active":"2024-06-11T16:03:50.817988+0000","last_peered":"2024-06-11T16:03:50.817988+0000","last_clean":"2024-06-11T16:03:50.817988+0000","last_became_active":"2024-06-11T16:03:01.080304+0000","last_became_peered":"2024-06-11T16:03:01.080304+0000","last_unstale":"2024-06-11T16:03:50.817988+0000","last_undegraded":"2024-06-11T16:03:50.817988+0000","last_fullsized":"2024-06-11T16:03:50.817988+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'25","last_scrub_stamp":"2024-06-11T16:03:50.817891+0000","last_deep_scrub":"90'25","last_deep_scrub_stamp":"2024-06-11T16:03:50.817891+0000","last_clean_scrub_stamp":"2024-06-11T16:03:50.817891+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T16:20:17.897953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"59'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.869681+0000","last_change":"2024-06-11T16:03:42.869707+0000","last_active":"2024-06-11T16:03:42.869681+0000","last_peered":"2024-06-11T16:03:42.869681+0000","last_clean":"2024-06-11T16:03:42.869681+0000","last_became_active":"2024-06-11T16:03:16.182287+0000","last_became_peered":"2024-06-11T16:03:16.182287+0000","last_unstale":"2024-06-11T16:03:42.869681+0000","last_undegraded":"2024-06-11T16:03:42.869681+0000","last_fullsized":"2024-06-11T16:03:42.869681+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-06-11T16:03:42.869589+0000","last_deep_scrub":"59'1","last_deep_scrub_stamp":"2024-06-11T16:03:42.869589+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.869589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:31:47.517379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"90'240","reported_seq":653,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:00.434278+0000","last_change":"2024-06-11T16:04:00.434325+0000","last_active":"2024-06-11T16:04:00.434278+0000","last_peered":"2024-06-11T16:04:00.434278+0000","last_clean":"2024-06-11T16:04:00.434278+0000","last_became_active":"2024-06-11T16:03:20.143852+0000","last_became_peered":"2024-06-11T16:03:20.143852+0000","last_unstale":"2024-06-11T16:04:00.434278+0000","last_undegraded":"2024-06-11T16:04:00.434278+0000","last_fullsized":"2024-06-11T16:04:00.434278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'240","last_scrub_stamp":"2024-06-11T16:04:00.434195+0000","last_deep_scrub":"90'240","last_deep_scrub_stamp":"2024-06-11T16:04:00.434195+0000","last_clean_scrub_stamp":"2024-06-11T16:04:00.434195+0000","objects_scrubbed":64,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T23:51:33.277079+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325969,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":325959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"55'1","reported_seq":180,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:42.368146+0000","last_change":"2024-06-11T16:03:42.368146+0000","last_active":"2024-06-11T16:03:42.368146+0000","last_peered":"2024-06-11T16:03:42.368146+0000","last_clean":"2024-06-11T16:03:42.368146+0000","last_became_active":"2024-06-11T16:03:15.192763+0000","last_became_peered":"2024-06-11T16:03:15.192763+0000","last_unstale":"2024-06-11T16:03:42.368146+0000","last_undegraded":"2024-06-11T16:03:42.368146+0000","last_fullsized":"2024-06-11T16:03:42.368146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'1","last_scrub_stamp":"2024-06-11T16:03:42.368010+0000","last_deep_scrub":"55'1","last_deep_scrub_stamp":"2024-06-11T16:03:42.368010+0000","last_clean_scrub_stamp":"2024-06-11T16:03:42.368010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:41:46.808720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"90'214","reported_seq":381,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:41.457863+0000","last_change":"2024-06-11T16:03:41.457863+0000","last_active":"2024-06-11T16:03:41.457863+0000","last_peered":"2024-06-11T16:03:41.457863+0000","last_clean":"2024-06-11T16:03:41.457863+0000","last_became_active":"2024-06-11T15:58:59.195699+0000","last_became_peered":"2024-06-11T15:58:59.195699+0000","last_unstale":"2024-06-11T16:03:41.457863+0000","last_undegraded":"2024-06-11T16:03:41.457863+0000","last_fullsized":"2024-06-11T16:03:41.457863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:03:41.457738+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:03:41.457738+0000","last_clean_scrub_stamp":"2024-06-11T16:03:41.457738+0000","objects_scrubbed":57,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:00:05.123165+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168332,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"90'221","reported_seq":569,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:53.840206+0000","last_change":"2024-06-11T16:03:53.840346+0000","last_active":"2024-06-11T16:03:53.840206+0000","last_peered":"2024-06-11T16:03:53.840206+0000","last_clean":"2024-06-11T16:03:53.840206+0000","last_became_active":"2024-06-11T16:03:14.160985+0000","last_became_peered":"2024-06-11T16:03:14.160985+0000","last_unstale":"2024-06-11T16:03:53.840206+0000","last_undegraded":"2024-06-11T16:03:53.840206+0000","last_fullsized":"2024-06-11T16:03:53.840206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'221","last_scrub_stamp":"2024-06-11T16:03:53.840105+0000","last_deep_scrub":"90'221","last_deep_scrub_stamp":"2024-06-11T16:03:53.840105+0000","last_clean_scrub_stamp":"2024-06-11T16:03:53.840105+0000","objects_scrubbed":48,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T20:37:06.260895+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145532,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":145532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"59'1","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:51.415088+0000","last_change":"2024-06-11T16:03:51.415115+0000","last_active":"2024-06-11T16:03:51.415088+0000","last_peered":"2024-06-11T16:03:51.415088+0000","last_clean":"2024-06-11T16:03:51.415088+0000","last_became_active":"2024-06-11T15:58:58.176541+0000","last_became_peered":"2024-06-11T15:58:58.176541+0000","last_unstale":"2024-06-11T16:03:51.415088+0000","last_undegraded":"2024-06-11T16:03:51.415088+0000","last_fullsized":"2024-06-11T16:03:51.415088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'1","last_scrub_stamp":"2024-06-11T16:03:51.415003+0000","last_deep_scrub":"59'1","last_deep_scrub_stamp":"2024-06-11T16:03:51.415003+0000","last_clean_scrub_stamp":"2024-06-11T16:03:51.415003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:13:43.570354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"90'202","reported_seq":580,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:58.388084+0000","last_change":"2024-06-11T16:03:58.388144+0000","last_active":"2024-06-11T16:03:58.388084+0000","last_peered":"2024-06-11T16:03:58.388084+0000","last_clean":"2024-06-11T16:03:58.388084+0000","last_became_active":"2024-06-11T16:03:19.138600+0000","last_became_peered":"2024-06-11T16:03:19.138600+0000","last_unstale":"2024-06-11T16:03:58.388084+0000","last_undegraded":"2024-06-11T16:03:58.388084+0000","last_fullsized":"2024-06-11T16:03:58.388084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'202","last_scrub_stamp":"2024-06-11T16:03:58.387993+0000","last_deep_scrub":"90'202","last_deep_scrub_stamp":"2024-06-11T16:03:58.387993+0000","last_clean_scrub_stamp":"2024-06-11T16:03:58.387993+0000","objects_scrubbed":47,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:37:45.161213+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242972,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":240313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":179,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:44.341968+0000","last_change":"2024-06-11T16:03:44.341968+0000","last_active":"2024-06-11T16:03:44.341968+0000","last_peered":"2024-06-11T16:03:44.341968+0000","last_clean":"2024-06-11T16:03:44.341968+0000","last_became_active":"2024-06-11T16:03:15.195530+0000","last_became_peered":"2024-06-11T16:03:15.195530+0000","last_unstale":"2024-06-11T16:03:44.341968+0000","last_undegraded":"2024-06-11T16:03:44.341968+0000","last_fullsized":"2024-06-11T16:03:44.341968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-11T16:03:44.341829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-11T16:03:44.341829+0000","last_clean_scrub_stamp":"2024-06-11T16:03:44.341829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:50:17.276224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"90'214","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:04.913338+0000","last_change":"2024-06-11T16:04:04.913376+0000","last_active":"2024-06-11T16:04:04.913338+0000","last_peered":"2024-06-11T16:04:04.913338+0000","last_clean":"2024-06-11T16:04:04.913338+0000","last_became_active":"2024-06-11T16:03:22.144426+0000","last_became_peered":"2024-06-11T16:03:22.144426+0000","last_unstale":"2024-06-11T16:04:04.913338+0000","last_undegraded":"2024-06-11T16:04:04.913338+0000","last_fullsized":"2024-06-11T16:04:04.913338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'214","last_scrub_stamp":"2024-06-11T16:04:04.913258+0000","last_deep_scrub":"90'214","last_deep_scrub_stamp":"2024-06-11T16:04:04.913258+0000","last_clean_scrub_stamp":"2024-06-11T16:04:04.913258+0000","objects_scrubbed":58,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T19:50:00.568183+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117860,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":117822,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"90'5","reported_seq":118,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:54.790536+0000","last_change":"2024-06-11T16:03:54.790576+0000","last_active":"2024-06-11T16:03:54.790536+0000","last_peered":"2024-06-11T16:03:54.790536+0000","last_clean":"2024-06-11T16:03:54.790536+0000","last_became_active":"2024-06-11T16:03:14.168164+0000","last_became_peered":"2024-06-11T16:03:14.168164+0000","last_unstale":"2024-06-11T16:03:54.790536+0000","last_undegraded":"2024-06-11T16:03:54.790536+0000","last_fullsized":"2024-06-11T16:03:54.790536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'5","last_scrub_stamp":"2024-06-11T16:03:54.790449+0000","last_deep_scrub":"90'5","last_deep_scrub_stamp":"2024-06-11T16:03:54.790449+0000","last_clean_scrub_stamp":"2024-06-11T16:03:54.790449+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:26:44.667344+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"90'221","reported_seq":339,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:36.839696+0000","last_change":"2024-06-11T16:03:36.839740+0000","last_active":"2024-06-11T16:03:36.839696+0000","last_peered":"2024-06-11T16:03:36.839696+0000","last_clean":"2024-06-11T16:03:36.839696+0000","last_became_active":"2024-06-11T16:03:14.177882+0000","last_became_peered":"2024-06-11T16:03:14.177882+0000","last_unstale":"2024-06-11T16:03:36.839696+0000","last_undegraded":"2024-06-11T16:03:36.839696+0000","last_fullsized":"2024-06-11T16:03:36.839696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'221","last_scrub_stamp":"2024-06-11T16:03:36.839605+0000","last_deep_scrub":"90'221","last_deep_scrub_stamp":"2024-06-11T16:03:36.839605+0000","last_clean_scrub_stamp":"2024-06-11T16:03:36.839605+0000","objects_scrubbed":62,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:16:32.206657+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161319,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"90'7","reported_seq":78,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:47.828106+0000","last_change":"2024-06-11T16:03:47.828138+0000","last_active":"2024-06-11T16:03:47.828106+0000","last_peered":"2024-06-11T16:03:47.828106+0000","last_clean":"2024-06-11T16:03:47.828106+0000","last_became_active":"2024-06-11T16:03:15.178278+0000","last_became_peered":"2024-06-11T16:03:15.178278+0000","last_unstale":"2024-06-11T16:03:47.828106+0000","last_undegraded":"2024-06-11T16:03:47.828106+0000","last_fullsized":"2024-06-11T16:03:47.828106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'7","last_scrub_stamp":"2024-06-11T16:03:47.827999+0000","last_deep_scrub":"90'7","last_deep_scrub_stamp":"2024-06-11T16:03:47.827999+0000","last_clean_scrub_stamp":"2024-06-11T16:03:47.827999+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T21:05:36.282753+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"90'213","reported_seq":334,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:08.057650+0000","last_change":"2024-06-11T16:04:08.057715+0000","last_active":"2024-06-11T16:04:08.057650+0000","last_peered":"2024-06-11T16:04:08.057650+0000","last_clean":"2024-06-11T16:04:08.057650+0000","last_became_active":"2024-06-11T16:03:23.150025+0000","last_became_peered":"2024-06-11T16:03:23.150025+0000","last_unstale":"2024-06-11T16:04:08.057650+0000","last_undegraded":"2024-06-11T16:04:08.057650+0000","last_fullsized":"2024-06-11T16:04:08.057650+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'213","last_scrub_stamp":"2024-06-11T16:04:08.057520+0000","last_deep_scrub":"90'213","last_deep_scrub_stamp":"2024-06-11T16:04:08.057520+0000","last_clean_scrub_stamp":"2024-06-11T16:04:08.057520+0000","objects_scrubbed":50,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:45:38.034846+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3889811,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":3941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":3889811,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"90'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:37.796175+0000","last_change":"2024-06-11T16:03:37.796214+0000","last_active":"2024-06-11T16:03:37.796175+0000","last_peered":"2024-06-11T16:03:37.796175+0000","last_clean":"2024-06-11T16:03:37.796175+0000","last_became_active":"2024-06-11T16:03:16.171493+0000","last_became_peered":"2024-06-11T16:03:16.171493+0000","last_unstale":"2024-06-11T16:03:37.796175+0000","last_undegraded":"2024-06-11T16:03:37.796175+0000","last_fullsized":"2024-06-11T16:03:37.796175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'3","last_scrub_stamp":"2024-06-11T16:03:37.796085+0000","last_deep_scrub":"90'3","last_deep_scrub_stamp":"2024-06-11T16:03:37.796085+0000","last_clean_scrub_stamp":"2024-06-11T16:03:37.796085+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:10:30.985749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"90'217","reported_seq":338,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:04:09.009933+0000","last_change":"2024-06-11T16:04:09.009965+0000","last_active":"2024-06-11T16:04:09.009933+0000","last_peered":"2024-06-11T16:04:09.009933+0000","last_clean":"2024-06-11T16:04:09.009933+0000","last_became_active":"2024-06-11T16:03:23.152080+0000","last_became_peered":"2024-06-11T16:03:23.152080+0000","last_unstale":"2024-06-11T16:04:09.009933+0000","last_undegraded":"2024-06-11T16:04:09.009933+0000","last_fullsized":"2024-06-11T16:04:09.009933+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'217","last_scrub_stamp":"2024-06-11T16:04:09.009834+0000","last_deep_scrub":"90'217","last_deep_scrub_stamp":"2024-06-11T16:04:09.009834+0000","last_clean_scrub_stamp":"2024-06-11T16:04:09.009834+0000","objects_scrubbed":56,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T18:21:16.957987+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116672,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":116672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"90'26","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:32.746062+0000","last_change":"2024-06-11T16:03:32.746093+0000","last_active":"2024-06-11T16:03:32.746062+0000","last_peered":"2024-06-11T16:03:32.746062+0000","last_clean":"2024-06-11T16:03:32.746062+0000","last_became_active":"2024-06-11T16:03:15.178812+0000","last_became_peered":"2024-06-11T16:03:15.178812+0000","last_unstale":"2024-06-11T16:03:32.746062+0000","last_undegraded":"2024-06-11T16:03:32.746062+0000","last_fullsized":"2024-06-11T16:03:32.746062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'26","last_scrub_stamp":"2024-06-11T16:03:32.745935+0000","last_deep_scrub":"90'26","last_deep_scrub_stamp":"2024-06-11T16:03:32.745935+0000","last_clean_scrub_stamp":"2024-06-11T16:03:32.745935+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:28:01.198525+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"90'234","reported_seq":348,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:40.888484+0000","last_change":"2024-06-11T16:03:40.888522+0000","last_active":"2024-06-11T16:03:40.888484+0000","last_peered":"2024-06-11T16:03:40.888484+0000","last_clean":"2024-06-11T16:03:40.888484+0000","last_became_active":"2024-06-11T16:03:14.178316+0000","last_became_peered":"2024-06-11T16:03:14.178316+0000","last_unstale":"2024-06-11T16:03:40.888484+0000","last_undegraded":"2024-06-11T16:03:40.888484+0000","last_fullsized":"2024-06-11T16:03:40.888484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'234","last_scrub_stamp":"2024-06-11T16:03:40.888400+0000","last_deep_scrub":"90'234","last_deep_scrub_stamp":"2024-06-11T16:03:40.888400+0000","last_clean_scrub_stamp":"2024-06-11T16:03:40.888400+0000","objects_scrubbed":63,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-12T22:36:22.791650+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374995,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"90'4","reported_seq":171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:55.295659+0000","last_change":"2024-06-11T16:03:55.295686+0000","last_active":"2024-06-11T16:03:55.295659+0000","last_peered":"2024-06-11T16:03:55.295659+0000","last_clean":"2024-06-11T16:03:55.295659+0000","last_became_active":"2024-06-11T15:58:58.177776+0000","last_became_peered":"2024-06-11T15:58:58.177776+0000","last_unstale":"2024-06-11T16:03:55.295659+0000","last_undegraded":"2024-06-11T16:03:55.295659+0000","last_fullsized":"2024-06-11T16:03:55.295659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'4","last_scrub_stamp":"2024-06-11T16:03:55.295568+0000","last_deep_scrub":"90'4","last_deep_scrub_stamp":"2024-06-11T16:03:55.295568+0000","last_clean_scrub_stamp":"2024-06-11T16:03:55.295568+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T03:17:22.860120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"90'258","reported_seq":381,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:55.059115+0000","last_change":"2024-06-11T16:03:55.059151+0000","last_active":"2024-06-11T16:03:55.059115+0000","last_peered":"2024-06-11T16:03:55.059115+0000","last_clean":"2024-06-11T16:03:55.059115+0000","last_became_active":"2024-06-11T16:03:04.096433+0000","last_became_peered":"2024-06-11T16:03:04.096433+0000","last_unstale":"2024-06-11T16:03:55.059115+0000","last_undegraded":"2024-06-11T16:03:55.059115+0000","last_fullsized":"2024-06-11T16:03:55.059115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'258","last_scrub_stamp":"2024-06-11T16:03:55.059034+0000","last_deep_scrub":"90'258","last_deep_scrub_stamp":"2024-06-11T16:03:55.059034+0000","last_clean_scrub_stamp":"2024-06-11T16:03:55.059034+0000","objects_scrubbed":63,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T01:03:08.008610+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269502,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":256348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"90'10","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-06-11T16:03:46.366241+0000","last_change":"2024-06-11T16:03:46.366277+0000","last_active":"2024-06-11T16:03:46.366241+0000","last_peered":"2024-06-11T16:03:46.366241+0000","last_clean":"2024-06-11T16:03:46.366241+0000","last_became_active":"2024-06-11T16:03:15.194230+0000","last_became_peered":"2024-06-11T16:03:15.194230+0000","last_unstale":"2024-06-11T16:03:46.366241+0000","last_undegraded":"2024-06-11T16:03:46.366241+0000","last_fullsized":"2024-06-11T16:03:46.366241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"90'10","last_scrub_stamp":"2024-06-11T16:03:46.366121+0000","last_deep_scrub":"90'10","last_deep_scrub_stamp":"2024-06-11T16:03:46.366121+0000","last_clean_scrub_stamp":"2024-06-11T16:03:46.366121+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-13T02:34:02.515961+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26775830,"num_objects":3449,"num_object_clones":0,"num_object_copies":6898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10636,"num_write_kb":39132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3929,"num_bytes_recovered":15415611,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64507904,"data_stored":53213968,"data_compressed":4521573,"data_compressed_allocated":5312512,"data_compressed_original":14032896,"omap_allocated":0,"internal_metadata":0},"log_size":13903,"ondisk_log_size":13903,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":42437181,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":36,"num_read_kb":347,"num_write":473,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":29685295,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15908864,"data_stored":84874362,"data_compressed":12454907,"data_compressed_allocated":14708736,"data_compressed_original":83738624,"omap_allocated":5569,"internal_metadata":0},"log_size":472,"ondisk_log_size":472,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":31998,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":71,"seq":304942678032,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69704,"kb_used_data":29696,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94302136,"statfs":{"total":96636764160,"available":96565387264,"internally_reserved":0,"allocated":30408704,"data_stored":55002960,"data_compressed":6323921,"data_compressed_allocated":7450624,"data_compressed_original":38879232,"omap_allocated":7164,"internal_metadata":40952836},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69024,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94302816,"statfs":{"total":96636764160,"available":96566083584,"internally_reserved":0,"allocated":24535040,"data_stored":44637238,"data_compressed":5935444,"data_compressed_allocated":7028736,"data_compressed_original":34140160,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72316,"kb_used_data":27252,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94299524,"statfs":{"total":96636764160,"available":96562712576,"internally_reserved":0,"allocated":27906048,"data_stored":40733009,"data_compressed":4738100,"data_compressed_allocated":5615616,"data_compressed_original":25915392,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9972,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":11013,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":21464807,"data_compressed":3097498,"data_compressed_allocated":3690496,"data_compressed_original":20860928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5746688,"data_stored":29524090,"data_compressed":4414430,"data_compressed_allocated":5218304,"data_compressed_original":29016064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5857280,"data_stored":33885465,"data_compressed":4942979,"data_compressed_allocated":5799936,"data_compressed_original":33861632,"omap_allocated":5569,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22822912,"data_stored":18900155,"data_compressed":1640602,"data_compressed_allocated":1925120,"data_compressed_original":5054464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17952768,"data_stored":14154733,"data_compressed":1511042,"data_compressed_allocated":1773568,"data_compressed_original":4550656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23732224,"data_stored":20159080,"data_compressed":1369929,"data_compressed_allocated":1613824,"data_compressed_original":4427776,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-11T16:04:12.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-11T16:04:13.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-11T16:04:13.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T16:04:13.323 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:04:13.323 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T16:04:13.323 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T16:04:13.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-11T16:04:13.655 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:04:13.655 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-11T15:58:58.506116+0000","modified":"2024-06-11T15:59:00.537380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4201":{"gid":4201,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.89:6803/1151219335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1151219335},{"type":"v1","addr":"172.21.15.89:6803","nonce":1151219335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4201,"qdb_cluster":[4201]},"id":1}]} 2024-06-11T16:04:13.655 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 5 2024-06-11T16:04:13.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-11T16:04:13.953 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-06-11T16:04:13.953 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":90,"fsid":"48aab8a4-b456-497c-bad9-c7e7b823c20e","created":"2024-06-11T15:58:39.314448+0000","modified":"2024-06-11T16:03:23.136276+0000","last_up_change":"2024-06-11T16:03:00.063621+0000","last_in_change":"2024-06-11T15:58:40.157171+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-11T15:58:49.605826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-06-11T15:58:54.347804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-06-11T15:58:57.116550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-06-11T15:58:57.479861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ef58ea1e-862f-4fd9-b48e-87a3ca753c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6801","nonce":4055503049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6803","nonce":4055503049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6807","nonce":4055503049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":4055503049},{"type":"v1","addr":"172.21.15.129:6805","nonce":4055503049}]},"public_addr":"172.21.15.129:6801/4055503049","cluster_addr":"172.21.15.129:6803/4055503049","heartbeat_back_addr":"172.21.15.129:6807/4055503049","heartbeat_front_addr":"172.21.15.129:6805/4055503049","state":["exists","up"]},{"osd":1,"uuid":"28556a85-d5a7-40a9-89e8-3a45e8eaaa35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6801","nonce":4023662438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6803","nonce":4023662438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6807","nonce":4023662438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":4023662438},{"type":"v1","addr":"172.21.15.163:6805","nonce":4023662438}]},"public_addr":"172.21.15.163:6801/4023662438","cluster_addr":"172.21.15.163:6803/4023662438","heartbeat_back_addr":"172.21.15.163:6807/4023662438","heartbeat_front_addr":"172.21.15.163:6805/4023662438","state":["exists","up"]},{"osd":2,"uuid":"95d745de-187c-44a3-a4b1-a203f06a1cc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":37,"up_from":71,"up_thru":89,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6801","nonce":3596598173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6803","nonce":3596598173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6807","nonce":3596598173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":3596598173},{"type":"v1","addr":"172.21.15.171:6805","nonce":3596598173}]},"public_addr":"172.21.15.171:6801/3596598173","cluster_addr":"172.21.15.171:6803/3596598173","heartbeat_back_addr":"172.21.15.171:6807/3596598173","heartbeat_front_addr":"172.21.15.171:6805/3596598173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.208604+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.254062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-11T15:58:45.183321+0000","dead_epoch":37}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-11T16:04:13.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-11T16:04:14.296 INFO:teuthology.orchestra.run.smithi089.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-11T16:04:14.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-11T16:04:14.332 INFO:tasks.ceph.mds.a.smithi089.stdout:starting mds.a at 2024-06-11T16:04:15.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-11T16:04:16.374 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_metadata' removed 2024-06-11T16:04:16.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-11T16:04:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'cephfs_data' removed 2024-06-11T16:04:17.399 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-11T16:04:17.399 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-11T16:04:17.399 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.409 INFO:tasks.ceph.mds.a:Stopped 2024-06-11T16:04:17.410 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-11T16:04:17.410 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-11T16:04:17.410 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.448 INFO:tasks.ceph.osd.0:Stopped 2024-06-11T16:04:17.449 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-11T16:04:17.449 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.483 INFO:tasks.ceph.osd.1:Stopped 2024-06-11T16:04:17.483 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-11T16:04:17.483 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.518 INFO:tasks.ceph.osd.2:Stopped 2024-06-11T16:04:17.518 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-11T16:04:17.519 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-11T16:04:17.519 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.543 INFO:tasks.ceph.mgr.x:Stopped 2024-06-11T16:04:17.544 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-11T16:04:17.544 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.611 INFO:tasks.ceph.mgr.y:Stopped 2024-06-11T16:04:17.611 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-11T16:04:17.611 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-11T16:04:17.611 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.662 INFO:tasks.ceph.mon.a:Stopped 2024-06-11T16:04:17.663 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-11T16:04:17.663 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.715 INFO:tasks.ceph.mon.b:Stopped 2024-06-11T16:04:17.715 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-11T16:04:17.715 INFO:teuthology.orchestra.run:waiting for 300 2024-06-11T16:04:17.767 INFO:tasks.ceph.mon.c:Stopped 2024-06-11T16:04:17.767 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-11T16:04:17.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-06-11T16:04:17.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi129.front.sepia.ceph.com 2024-06-11T16:04:17.842 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-11T16:04:17.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T16:04:17.983 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-11T16:04:18.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T16:04:18.105 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-11T16:04:18.359 INFO:tasks.ceph:Archiving mon data... 2024-06-11T16:04:18.360 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/data/mon.a.tgz 2024-06-11T16:04:18.361 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-06-11T16:04:18.378 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.ee72YAPv7i 2024-06-11T16:04:18.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ee72YAPv7i 2024-06-11T16:04:18.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.ee72YAPv7i 2024-06-11T16:04:18.615 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.ee72YAPv7i is 365KB 2024-06-11T16:04:18.710 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.ee72YAPv7i 2024-06-11T16:04:18.725 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/data/mon.b.tgz 2024-06-11T16:04:18.725 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-06-11T16:04:18.780 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.kSp30EenNO 2024-06-11T16:04:18.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kSp30EenNO 2024-06-11T16:04:18.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.kSp30EenNO 2024-06-11T16:04:19.028 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.kSp30EenNO is 509KB 2024-06-11T16:04:19.127 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.kSp30EenNO 2024-06-11T16:04:19.142 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/data/mon.c.tgz 2024-06-11T16:04:19.143 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-06-11T16:04:19.197 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.smybseYVD3 2024-06-11T16:04:19.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.smybseYVD3 2024-06-11T16:04:19.360 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.smybseYVD3 2024-06-11T16:04:19.442 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.smybseYVD3 is 508KB 2024-06-11T16:04:19.539 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.smybseYVD3 2024-06-11T16:04:19.554 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-11T16:04:19.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T16:04:19.595 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T16:04:19.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T16:04:19.601 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-11T16:04:19.672 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T16:04:19.690 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T16:04:19.708 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T16:04:19.725 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-11T16:04:19.725 INFO:tasks.ceph:Archiving crash dumps... 2024-06-11T16:04:19.727 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi089/crash 2024-06-11T16:04:19.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T16:04:19.751 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi129/crash 2024-06-11T16:04:19.752 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T16:04:19.797 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi163/crash 2024-06-11T16:04:19.798 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T16:04:19.836 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi171/crash 2024-06-11T16:04:19.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-11T16:04:19.873 INFO:tasks.ceph:Compressing logs... 2024-06-11T16:04:19.873 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T16:04:19.876 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T16:04:19.878 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T16:04:19.880 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-11T16:04:19.897 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31251.log 2024-06-11T16:04:19.897 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2024-06-11T16:04:19.904 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-11T16:04:19.911 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-06-11T16:04:19.971 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31491.log 2024-06-11T16:04:19.971 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31251.log.gz 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46339.log 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31491.log.gz 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34627.log 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46339.log.gz 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5/var/log/ceph/ceph-client.admin.45815.log: --verbose -- /var/log/ceph/ceph-client.0.34189.log 2024-06-11T16:04:19.972 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37518.log 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34627.log.gz 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.0.34189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr: 32.7% -- replaced with /var/log/ceph/ceph-client.0.34189.log.gz 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37518.log.gz 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34716.log 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-06-11T16:04:19.973 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35843.log 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34716.log.gz 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46319.log 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35843.log.gz 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38544.log 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-06-11T16:04:19.974 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46825.log 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46319.log.gz 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38544.log.gz 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46825.log.gz 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35080.log 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47496.log 2024-06-11T16:04:19.975 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34491.log 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35080.log.gz 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40499.log 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47496.log.gz 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35211.log 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34491.log.gz 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-06-11T16:04:19.976 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40499.log.gz 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35211.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35211.log.gz 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45641.log 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-06-11T16:04:19.977 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37435.log 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34538.log 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45641.log.gz 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37435.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37435.log.gz -- 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-client.admin.37046.log 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34538.log.gz 2024-06-11T16:04:19.978 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47664.log 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47371.log 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr: 94.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47664.log.gz 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47371.log.gz 2024-06-11T16:04:19.979 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37612.log 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32830.log 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34894.log 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37612.log.gz 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35347.log 2024-06-11T16:04:19.980 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32830.log.gz 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35347.log.gz 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31414.log 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47287.log 2024-06-11T16:04:19.981 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31414.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31414.log.gz 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36105.log 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47287.log.gz 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31712.log 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32107.log 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36105.log.gz 2024-06-11T16:04:19.982 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31712.log.gz 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32107.log.gz 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33607.log 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33211.log 0.0% 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47622.log 2024-06-11T16:04:19.983 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33607.log.gz 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33211.log.gz 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47622.log.gz 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45684.log 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-06-11T16:04:19.984 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31285.log 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32791.log 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45684.log.gz 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31285.log.gz 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-06-11T16:04:19.985 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47724.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30171.log 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.30171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30171.log.gz 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37344.log 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-06-11T16:04:19.986 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37344.log.gz 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37793.log 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2024-06-11T16:04:19.987 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37793.log.gz 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34993.log 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35570.log 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-06-11T16:04:19.988 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35796.log 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34993.log.gz 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36366.log 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35570.log.gz 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31842.log 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35796.log.gz 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33503.log 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36366.log.gz 2024-06-11T16:04:19.989 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31842.log.gz 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36279.log 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33503.log.gz 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36495.log 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36279.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36279.log.gz 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-06-11T16:04:19.990 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36495.log.gz 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35483.log 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37876.log 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32413.log 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35483.log.gz 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36453.log 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37876.log.gz 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2024-06-11T16:04:19.991 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32413.log.gz 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47456.log 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36453.log.gz 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47456.log.gz 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45183.log 2024-06-11T16:04:19.992 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34937.log 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38620.log 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45183.log.gz 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34937.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34937.log.gz 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38620.log.gz 2024-06-11T16:04:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32371.log 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32023.log 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32371.log.gz 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32023.log.gz 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-06-11T16:04:19.994 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32917.log 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32917.log.gz 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-06-11T16:04:19.995 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38022.log 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38022.log.gz 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34758.log 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-06-11T16:04:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34758.log.gz 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42260.log 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35707.log 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42260.log.gz 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45461.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz -5 2024-06-11T16:04:19.997 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33775.log 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35707.log.gz 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47414.log 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33775.log.gz 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46741.log 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47414.log.gz 2024-06-11T16:04:19.998 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46741.log.gz 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33127.log 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39441.log 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32665.log 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33127.log.gz 2024-06-11T16:04:19.999 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39441.log.gz 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35167.log 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32665.log.gz 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33043.log 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32238.log 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35167.log.gz 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33043.log.gz 2024-06-11T16:04:20.000 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34667.log 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36192.log 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32238.log.gz 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39017.log 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34667.log.gz 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36237.log 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36192.log.gz 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39017.log.gz 2024-06-11T16:04:20.001 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35037.log 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36237.log.gz 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35037.log.gz 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32937.log 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31935.log 2024-06-11T16:04:20.002 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32937.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32937.log.gz --verbose 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.37220.log 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36918.log 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31935.log.gz 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37220.log.gz 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32149.log 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45272.log 2024-06-11T16:04:20.003 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36918.log.gz 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38108.log 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32149.log.gz 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45272.log.gz 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46613.log 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36540.log 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38108.log.gz 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37835.log 2024-06-11T16:04:20.004 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36540.log.gz 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38519.log 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37835.log.gz 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32577.log 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38519.log.gz 2024-06-11T16:04:20.005 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32577.log.gz 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-06-11T16:04:20.006 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35930.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33085.log -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33085.log.gz 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37664.log 2024-06-11T16:04:20.007 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33461.log 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37664.log.gz 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47580.log 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33461.log.gz 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47580.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.47580.log.gz --verbose 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-client.admin.46233.log 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45983.log 2024-06-11T16:04:20.008 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46233.log.gz 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45983.log.gz 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 2024-06-11T16:04:20.009 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32578.log 2024-06-11T16:04:20.010 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35885.log 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32578.log.gz 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42694.log 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.40425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32192.log 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35885.log.gz 2024-06-11T16:04:20.011 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.42694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42694.log.gz 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36407.log 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32192.log.gz 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37751.log 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36407.log.gz 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz 2024-06-11T16:04:20.012 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36959.log 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37751.log.gz 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35529.log 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36059.log 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36959.log.gz 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35529.log.gz 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45857.log 2024-06-11T16:04:20.013 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36059.log.gz 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45857.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.45857.log.gz -5 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.35388.log: -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-06-11T16:04:20.014 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.47767.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz -5 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46106.log 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34447.log 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46106.log.gz 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2024-06-11T16:04:20.015 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34447.log.gz 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31977.log 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37960.log 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31977.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31977.log.gz 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33690.log 2024-06-11T16:04:20.016 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46105.log 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37960.log.gz 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33690.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33690.log.gz 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35618.log 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.46105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31040.log 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46105.log.gz 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35618.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35618.log.gz 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36583.log 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31040.log.gz 2024-06-11T16:04:20.017 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36583.log.gz 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35258.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32977.log 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31798.log 2024-06-11T16:04:20.018 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32977.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32977.log.gz 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31798.log.gz 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37477.log 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.45317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37477.log.gz 2024-06-11T16:04:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31589.log 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34847.log 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31589.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33337.log 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31589.log.gz 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34847.log.gz 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.33337.log: /var/log/ceph/ceph-client.admin.31893.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-06-11T16:04:20.020 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37303.log 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.34580.log: 0.0% 48.4% -- replaced with /var/log/ceph/ceph-client.admin.33337.log.gz 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37303.log.gz 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46655.log 2024-06-11T16:04:20.021 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38463.log/var/log/ceph/ceph-client.admin.45773.log: 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz/var/log/ceph/ceph-client.admin.46655.log: 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46655.log.gz 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38463.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38463.log.gz 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35972.log 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-06-11T16:04:20.022 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35972.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35972.log.gz 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.32704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31547.log 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.39894.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38416.log 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.31547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31547.log.gz 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35300.log 2024-06-11T16:04:20.023 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.38416.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38416.log.gz 2024-06-11T16:04:20.024 INFO:teuthology.orchestra.run.smithi089.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37568.log 2024-06-11T16:04:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.35300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35300.log.gz 2024-06-11T16:04:20.024 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37568.log.gz 2024-06-11T16:04:20.024 INFO:teuthology.orchestra.run.smithi089.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-06-11T16:04:20.025 INFO:teuthology.orchestra.run.smithi089.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-11T16:04:20.025 INFO:teuthology.orchestra.run.smithi089.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-11T16:04:20.026 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777.log 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31776.log 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31816.log 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777.log.gz 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31856.log 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31776.log.gz 2024-06-11T16:04:20.027 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31816.log.gz 2024-06-11T16:04:20.028 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31856.log.gz 2024-06-11T16:04:20.106 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-11T16:04:20.184 INFO:teuthology.orchestra.run.smithi089.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-11T16:04:20.185 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-06-11T16:04:20.186 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.298s 2024-06-11T16:04:20.186 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m0.634s 2024-06-11T16:04:20.186 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.132s 2024-06-11T16:04:21.017 INFO:teuthology.orchestra.run.smithi171.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-11T16:04:21.019 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-06-11T16:04:21.019 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m1.087s 2024-06-11T16:04:21.019 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m0.997s 2024-06-11T16:04:21.020 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.052s 2024-06-11T16:04:21.890 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.1.log: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-11T16:04:21.892 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-06-11T16:04:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m1.997s 2024-06-11T16:04:21.892 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m1.923s 2024-06-11T16:04:21.893 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.082s 2024-06-11T16:04:23.389 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-osd.0.log: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-11T16:04:23.391 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-06-11T16:04:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m3.499s 2024-06-11T16:04:23.391 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m3.353s 2024-06-11T16:04:23.392 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.151s 2024-06-11T16:04:23.392 INFO:tasks.ceph:Archiving logs... 2024-06-11T16:04:23.392 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi089/log 2024-06-11T16:04:23.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T16:04:23.682 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi129/log 2024-06-11T16:04:23.683 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T16:04:24.189 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi163/log 2024-06-11T16:04:24.191 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T16:04:24.492 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi171/log 2024-06-11T16:04:24.494 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-11T16:04:24.659 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-11T16:04:24.668 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-11T16:04:24.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T16:04:24.671 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T16:04:24.674 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T16:04:24.677 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-11T16:04:24.792 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-11T16:04:24.801 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-11T16:04:24.801 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T16:04:24.803 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T16:04:24.806 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T16:04:24.808 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-11T16:04:24.818 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-06-11T16:04:24.818 INFO:teuthology.orchestra.run.smithi129.stderr:bash: line 1: ntpq: command not found 2024-06-11T16:04:24.823 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T16:04:24.823 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-06-11T16:04:24.823 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +1408us[+1417us] +/- 65ms 2024-06-11T16:04:24.823 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -2010us[-2010us] +/- 77ms 2024-06-11T16:04:24.823 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +394us[ +404us] +/- 75ms 2024-06-11T16:04:24.824 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T16:04:24.824 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-06-11T16:04:24.825 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T16:04:24.825 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-06-11T16:04:24.826 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +1395us[+1397us] +/- 65ms 2024-06-11T16:04:24.826 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -2038us[-2038us] +/- 77ms 2024-06-11T16:04:24.826 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +382us[ +384us] +/- 75ms 2024-06-11T16:04:24.826 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T16:04:24.826 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1391us[+1402us] +/- 65ms 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -2025us[-2014us] +/- 77ms 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +394us[ +394us] +/- 75ms 2024-06-11T16:04:24.828 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T16:04:24.830 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-11T16:04:24.830 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-06-11T16:04:24.830 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 37 30 +1388us[+1451us] +/- 65ms 2024-06-11T16:04:24.830 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 31 -2031us[-1969us] +/- 76ms 2024-06-11T16:04:24.831 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 31 +381us[ +444us] +/- 75ms 2024-06-11T16:04:24.831 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-06-11T16:04:24.831 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-11T16:04:24.840 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-11T16:04:24.840 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-11T16:04:24.866 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-11T16:04:24.936 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-11T16:04:25.001 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-11T16:04:25.072 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-11T16:04:25.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T16:04:25.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:25.226 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T16:04:25.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:25.255 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T16:04:25.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:25.286 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-11T16:04:25.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:25.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-11T16:04:25.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-11T16:04:25.366 INFO:teuthology.task.internal:Duration was 763.472103 seconds 2024-06-11T16:04:25.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-11T16:04:25.399 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-11T16:04:25.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T16:04:25.402 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T16:04:25.404 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T16:04:25.406 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-11T16:04:25.442 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T16:04:25.442 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T16:04:25.447 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T16:04:25.468 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-11T16:04:25.750 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-11T16:04:25.751 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-06-11T16:04:25.751 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T16:04:25.774 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-06-11T16:04:25.774 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T16:04:25.795 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-06-11T16:04:25.795 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T16:04:25.823 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-06-11T16:04:25.823 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-11T16:04:25.851 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-11T16:04:25.851 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T16:04:25.853 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T16:04:25.856 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T16:04:25.865 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-11T16:04:25.922 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-11T16:04:25.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T16:04:25.925 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T16:04:25.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T16:04:25.934 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-11T16:04:26.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-11T16:04:26.050 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-11T16:04:26.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T16:04:26.074 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T16:04:26.099 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T16:04:26.123 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-11T16:04:26.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-11T16:04:26.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.165 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.167 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.186 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-06-11T16:04:26.188 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-06-11T16:04:26.190 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-06-11T16:04:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-06-11T16:04:26.272 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:26.287 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:26.302 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:26.316 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-11T16:04:26.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-11T16:04:26.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-11T16:04:26.343 INFO:teuthology.task.internal:Transferring archived files... 2024-06-11T16:04:26.344 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi089 2024-06-11T16:04:26.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T16:04:26.378 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi129 2024-06-11T16:04:26.378 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T16:04:26.411 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi163 2024-06-11T16:04:26.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T16:04:26.444 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-10_21:32:02-powercycle-squid-distro-default-smithi/7749448/remote/smithi171 2024-06-11T16:04:26.444 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-11T16:04:26.479 INFO:teuthology.task.internal:Removing archive directory... 2024-06-11T16:04:26.480 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T16:04:26.482 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T16:04:26.485 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T16:04:26.487 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-11T16:04:26.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-11T16:04:26.544 INFO:teuthology.task.internal:Not uploading archives. 2024-06-11T16:04:26.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-11T16:04:26.600 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-11T16:04:26.601 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T16:04:26.603 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T16:04:26.605 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T16:04:26.608 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-11T16:04:26.616 INFO:teuthology.orchestra.run.smithi089.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 11 16:04 /home/ubuntu/cephtest 2024-06-11T16:04:26.618 INFO:teuthology.orchestra.run.smithi129.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 11 16:04 /home/ubuntu/cephtest 2024-06-11T16:04:26.620 INFO:teuthology.orchestra.run.smithi163.stdout: 265316 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 11 16:04 /home/ubuntu/cephtest 2024-06-11T16:04:26.625 INFO:teuthology.orchestra.run.smithi171.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 11 16:04 /home/ubuntu/cephtest 2024-06-11T16:04:26.626 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-11T16:04:26.635 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-11T16:04:26.704 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} duration: 763.4721033573151 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi089 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3f51ea3944d39ca13aa40153c9a4ee298306679d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f010bac23e314c18baf1790a113aa7da status: fail success: false 2024-06-11T16:04:26.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-11T16:04:26.779 INFO:teuthology.run:FAIL